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analyses of- fyretest and posttest data showed that the course was 
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►pretest and posttest perfo|^mance revealed sigrlif icantwgaM|S for each, 
student. Recommendations f or future* research and course Optimization 
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This study was designed to determine whether or not a.aomputer- 
assisted instruction phonics program could 'be developed and validated so 
that 80 percent of the subjects would achieve 80* percerrr of the tet ;«inaT 
criterion obiectives. Several related purposes of the study were to 
answer /these, questions: • . \ . 

'Si * 1 V 

1. What is the general status of the pres^rvice teachers* .X 
knowledge jtn phonics prior to the' cdinputer-Msisted phonics t 



program? 



2. How effective were the cueing aad -practice materUls of .the 
program as determined by the difficulty iBvel (80..percent) 
of the rtiastery items? .^^ - 

^ 3. Which criterion t#st items met the 80 perxent criterion 
level aluJ which warranted revision? 

^/ 4. What rs the feasibility of the instructional strategies and 
tactics employed in the testing and instructional programs? 

5. How efficient were the authoring. and technical operations?^ 
during program development and operation? 

The program was a*niiTistered/via the IJM 1500 Instructional Sys- 

tem^to the validatiftn group during tKe fa>l of 1972: Each of the 36 

' students in the validation group w^s an undergr^duat^ and enrolled in 

the undergraduate reading methods, course. The students wew adminis-^ 

^ered the pretest, branched to instrufti^on based on pretest performance 

-aiid administered a.posftest off-line. ^ * ^ 

Posttest performance ifrdicated that trfe course was valid for 

instruction at the designated level for the subjects with^om 1t was 

used. The analysis of the inoourse materials reveatfid that more than 75 

• percent of the maStpry /items recorded difficulty levels at or above 80 

. :\ \ • 
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percent. A comparison- of the pre and postte^st performance revealed 
empirically significant gains for each student. These gains indicated 
that the CAI program was effective in char^ging the behaviors of the 
students. ' ^ ^ . 

.The Strategies of branching based on pretest performance, the 
use of/*illustrative lessons, student self-evaluation, comput&r-evalua- 
tion of multi -lined constructed^responses proved to be viable 
Strategies. 

The operations analysis showed maximum use. of the' computer, pre 
planning, as assets of the course development pha^ Some j imitations 
of course operations were pointed out: 'last minute changes, rusH for 
data from, student records, lack^of coordination of staff personnel 
during the initi aliases of the program. ' 

These recommendations were, made wfor further research and course 
optimization:' 

» 1. ^The .course should be a required unit of instruction for pre- 
service reading teachers i 
used for updating and opti 



service reading teachers and that tJiese future group£ be 

timizing the course. ^ i 



2.. A "mastery model" shoifld be inccMrporated and, that this 
mastery model be tested with a 90/90 criterion level.' 

3. Some consequential efaluation should fpllow the revised 
, course so that the/ieffects of tl>e program onjchahging ' 
teachers' cl ass roMi, behaviors may be determined.- 

'4. Rftseafichers and^'course developprs should use a minirpum of - 
three testing groups with' a minimum df 15 students typical 
of t>» validation population before running the validation 
/ study\ • ; ^ . > 
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JNTRODUCTIOJ 



Origin of and Need f or the Study ' ' - / - ' . ^ / 

*. ^ Ilore than a decade ago^ a conference of reading experts 

( learning to Read , 1962) repbrt^d a consensus on the value of phonics: 

We consider phonics oi^"^ of the' essential skills that help 
childc^n identify printed words' that they have not^seen before and 
then understand the meaning t,hftt these words repr^S^nj;. Without 
phonics most chi Idrep^annot become self-reliant, ^discriminating, 
efficjjent readers, [p^ 3] ^ . 

. . " ' ^ ' • / . , ^' 

_ T This statement set the stage for further individual testimony 

regar<ling the importance of phonic analysis, bmith (1963) alleged / 

that word recognition is the most fundamental of tt^ reading skills 

and tiiat without the ^bi^^ty to recognize words, the heading process 

cannpt proceed. ^ McEathron (1963) paralled Smith's (1963) ^1 legation 

by attesting that many children vyill never master reading sIcH^ls 

unless they are well taught the simple phortetic prindiples. Heilman 

(.1968) pointed -out that children itiust learn to associate speech sounds 

^Ith the printed letter representations'. In fact, he be] ieves' that if 

a pupij does not develop \ technique for "sounding out"#4jnfamil iar 

words,. his chances of becoming an independent reader are slight. So ^ 

important is this skill to children that it mus t'* be , taught systeinati- 

cally and well . ^ ' ^ 

. Moreover, skill in teaching i^honic analysis has* Jieen ^esig- 

t 

n§ted one. of the mqst essential skills for reading teachers. (Betts, 
1955; Heilman, 1963; Curry and Rigby, 1969; Spache and^Bagget, 1965). , 



Norton (1959) pointed out thdt successful teachi^ng of readmy at the 
Intermediate level was depet>dent dn teachers acquiring a sound knowl 
edge of the bask skills involved in ^ord recogohtion 

While the need^for good phonics ii'istruction for chiliirea has 
been firmly, established, there are serious' doubts regarding the ade-^. 
quacy of phonics Instruction ip classrooms today. Research (Bond'and 
Tinker, 19G7) into reading^ dis^abi 1 ity reVeaJs that ^ack of or ineffe.c- 
tive word an^lysjs skills Is one of the major disabilities among ^is- 
abled readers in the eV^.ientary- school s this findi/ig extends into 
the high schools and colleges where, as Ford (1971) observed, more 
than half of tl^e students entering the small colleges are di-sabled 
readers wfitfSe major impediments are the inability to rpcognize words 
qtiickly and accurately, d1>/1d& viords Into s>^|||bles and pronounce 
words. She concluded, from her exp.erlences, that th6se students w^U 
not gain muc)i from training In vocabulary development, rate and comr 
prehension unless they master wprd analysis sk4ns. • \ 

^ ^ihlle the causes o^ reading disability. tend to be complex, one 
factor contributing to ^any reading disabll ities^ is ^^nef fecti ve 
teaching (B(Jnd and'TiT)ker, 1967). But to what Tnay inadequate teactiing 
be attrlbutW? It Is realistic to assume that pre and inserviice 
teachers want' to do a good/jab. One reason- that they do not do so is 
that they haVe not beecK^taught' how and in some cases what to teach. 
This hypothesis Is based on tjje theory (Popham, 1965) that the rela- 
felonshlp between 'teacher effectiveness and teach^ knowledge of con- 
tent Is positive and high. Granted that this theory is'iound, one 
training source to be reckoned with Is the teacher training * * 

institution. ' . ' 



I 



( 



/ 




An investigation directed by Austin (Austin; MorrH>s;onf, -C; 



Kenny; Morrf son, M.; Gutmann and Nystrom, 196-1) revealed that many 
prospective teachers do notirave the necessary kpbwiedge base in^^ 
phon^iss." -The investigators reported that college supervisors and 
cbpperatfng teachers^ agree(i that the greatest content tlefrcit of student 



teachers in Reading was a lack of understanding of phonetic principles; ^ 
This group of experts recommended. that college instructors take- greater 
respcmsibility in making certain that their students have rnastered the 
principles of .letter-sound relationships and structural analysis/ . ' 

V Pari nel la's (1960) appraisal of teacher knowledge of phonetic 
and ^structural analysis led him to conclude that while teachers 
readily admit the importance of phonic analysis instruction in ttieir 
Jobs as reading teachers, they lack the necessary knowledge to teach , 
these^skills. Studies by Aaron (196Q)Jin(^Spache (1965) disclosed 
that the teacher subj|Cts^n their riespective investigiitipn^>hdd lim- 
ited knowledge of phonies'^ and syllabication and confirmed the need for 
upgrading preservice instruction in phonicS/and phonics prlnciplesfor 
primary and intermediate grade teachers. ) 

It is highly probable that the extensiveness ot the phonics 



J: 

fcdive t 



content does- not render tt likely to rifcdive" the ^ul 1 and intensive 

. . , *» , • 

coverage that such an imporUnt word analysis Sicill merits. Hence, 

preservice teachers are givem an overview of phonics in their methods 

courses that is hardly sufficient to giv^ them the necessary tlnowledges 

and skills for teaching phonic analys,is effectively. 

^ Hull (1969) reasoned that the training of teachers in methods. 

courses— specifically tn the area of phonics— is probably ineffective 



"7" 
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because , the teaching of phorjics cotit^ and the strategies and princi 
pies involvg^^ i}f\ teaching phonic analysfls^^ enormous and time con- 



suming task%. Spache and Baggetts* (1965) and Aaron^s (1960) find/ngs. 

^ dq not suggest that te^ichers w111^>earn to teach letter-sound »rela- 
tionships effectively simply by* teaching. For while exper'ienced 
teacher groups appeared to know ij^ore phonics than di(l inexperienc|(J 
teachers, neither, group' sf collective knowledge was impressive^ ^ 

JJinkley, (1971) after years of work with gratJ Date, students and inserv- 
i|pe trainirig programs for reaitiij^ teachers*^ ^vered t^at the a^era^e 

^teacher of reading does not know as much phartics^tis tfie average^Ahird- 
grade pupil . ' . ' - ^ 

-^Present e^lei^ntary scho^^lassroom instruction in phonic 
analysis* demands- ttidt prgservice trainirfg take on a greater responsi- 

ability I'n^h^lpfng teachers master the content of phonics Instruction 
before going into the classroom. To date, preservice methods courses 
have not met this responsibility fully. The(State of methods courses 
is \^wed by reading specialists '(Norton, 1959; Austir). 1961; 

r 

Spache, G. arnJ Spactie, E.,ll97iy as warranting review ^nd revision 
mainly beCiSuse classrooms are manned by men and ^omen who are ncft 
fully preg^rejt^ta teach readrng^ ^ ^ 

The question of How to bestjprovide the content and procedural 
guides for phorvics instruction that *re needed by teachers has not 
teen answered in t>ie literature. Having teachers learn on their own 
appears to be inadequate;, "learningpwhile ^teaching" seems to be toa 
risky for It cannot.be assumed that put)ils are receiving a good and 
systeinatic Ijase in phonics whITe their teachers learn; methods courses 
apparently laclc the time to go into the contejfTtjof phonics thoroughly. 



While methoiis courses have been appraised and methods cpurse,-<^eachers 

' apprised of the limitatiops of the courses, little has been initiated 

to^effedt positive changed Teachers have been constantly- impressed. 

with their respoi|siti.lity for^ teaching phohjcs; rqethods ccrOrses have 

been hande'd directives for content. Unfort;unately, vefy little con- 
r ' ' • * • ' . \ r\ 

crete'instructional iroprovetfnent has been generated by the criticism. 

It has-been recommejided that teacher-education institutions conduct , 

reseam:h to investigate and determine the fealsibKlity of various types 

of programs which are purpdrted to be promising in instructional quSl- 

ity. few programs have been Investigated. Possibilities for educa- 

^ing teachers in pljj^iics must- be explored if the problem of poor ^ 

phonicsMnstructton in the classroom is to *be. alleviated. 

Since the content of phoniac and procedures and principle^ for 

! ^ ' • ' ^ / \. 

teaching pflwiic an^ilysis to children are so inclusive,, jt is. very 

unlikely jthat preservlce teachers could master the content even if a 

largec segment of tim^ were appropriated 1h methods courses. There 

wouVd be many students receiving both repetitious information and 

» * 

practices too many students would not get enough practice to master 
the content. Students' prior knowledge, learning rates and working 
rates are all variables to be considered aryl accommodated If learning 
is to be opt^lmlzefl. If every student were provided only that^nforma- 
tlon necessary for him to achieve certain prescribed objectives and if 
he were presented that Information at a rat§ »hd In portions suitable 
for h1m> It Is ax1omat16 that most learners would<achieve mastery of 
the material to be learned. Such an approach to learning Is called 
the Individualized Approach. ' 




i.' 



Research (Klaus, 1969) contrasting: thje conventional methods ,c# 

* • * - ^ 

teaching and approaches wfich focys on learner .performance suggests 
that efforts to individuaTIze Instructlorr so th^t each learner can 
receive the practice be needs for complete ma/stery are far inore effec- 
tive than sol u*'ions which stress the communication and presentation 
charactef^istic of educational methods. Klaus (T969) has pointed out 

however, that .the application of Individual tzed instruction in educa- 

^ » . *■< 

tion has teen limited because there ha^ beert^the problem of devising 

techniques to provide the necessary control over learning in thp 

absence of human supervision, for extentied* peniods of time. 

It ma3^ oe reasoned, that individualized instruction is the best 
A 

approach for' teaching phonics content to preservice teachers. The 

• < 

search for a technique through which individualized instruction might 
^ 

reach fr4i1ti'0n was undertaken. At the moment, educational tech- 

nology--in the form of computer-assisted instruction--appears to hold 

*. • » 

considerable promise for optimizing, by individualizing, instruction 
in phonics for preservice teachers. • 

Research with computer-assisted instruction indicates that 
these computer system^ can accommodate a variety of subject matter 
content and different types of* learners. The ultimate success of a 
CAi course depends on the quality of 'the course materials de^^eloped; 
however, the opportunities offei^ed for Individualizing, sequencing. and 
controlling Ipstructton and adapting to various learning, rates enhance 
the effectiveness of the presentation of the materials to be learned. 



r 



The principles^ undeVgirding computer-cassis ted instruction 



' (CAI) lend themselves- well to the construction of an ideal learrti 



en^^ironment 



ng 



■ r\ 



A. The learner 1s an active participant. 

2. Repetition of tasks Is achieved thr^ough t^^fentatlon of 
stimuli rather than by repetition of the same stimuli- 

3, There Is a deliberate ply. to pre^nt a rTnge of condi- 
tions to which 'learning must 'be gerferalized. 

4, NoNTelt^ accompanies lea'rnlng. 

5. Knowledge Is gradual ly. presented In levels of difficulty- 
. V 6. Feedback dimensions are both cognltlve-iaAd evaluative. 

* v ^ • • . • - 

7. Learners are Involved In goal setting,' pacing and 
ev^lu^tlon. ^ ' / ^ 

8. DiVferent kinds of th1nk1nq%fe stimulated.. 

The application of these principles in developing a CAI course 

Jn phonics should result in a blending of the teaching process and the; 

* p 
content to best meet the needs of the learner. This is sometWng 

that many ^eacher-training co^jrses do not now effectively accomplish. 

More specifically, CAI has 'been selected as the media through 

which an effective teacher training course in phonics may be realized 

becaus|.,the system offers the rich 'interface cpmpopents— audio units. 



\. StoluroW, Instructor, CAI Seminar sponsored by Control 
Data Corporation, Silver Spring, Maryland, May 25, 1971. 

^ 

^Ibid. - 

The system referred to is the IBM 1500. It must be mentioned 
that not all tefminal^.or systems offer the interface components 
named. ' 



Image reels— that are i^nportant to phonics learfiing. A descriptton of • 
the JBM 1500 Instructional System and a corrflguratlon'of the CAI system 
are fo'undwvn Appendix A. In addltloh, tlie learning of Che^honifcs'^ 
'material by the prospectlj^e^-teachef:^ may be virtual ly .guaranteed with a 
tested dhd valfdate^ course; this statement.may hot be justified If it 
Is made about traditional classroom exposure, Independent student wbrk^' 
or the use of ' the^prbgrammed text. 

In order to de^terml/ie tbe viability of computer-ai^^lsted 
phonics Instruction for teachers, a CAI program was developed for 
teyting and validation. ^ . 

Overview of the Objectives ' / • \ > " / 

The primafhy objpctives of this exploratory research werero 
develop, /test, revise, retest and validate a CAI program in phonics 
for preservice teachers. To implemeat these objectfves, tjie following % 
were produced: . / ^ 

1. Scope and sequence of instructioh \ 
^ • 2. Terminal criterion behavioral objectives * ^ 

3. ' Criterion test Itenis^ 

4. Instructionefl materials suitable for the CAI system 

components— 'cayiode ray tube (CRT)^- audio unit, image 

■ . ' J0 ■ ■ 

projector 



5. Flowcharts of ijistructional Rjrocesses and decisions 

6. Course validation plan and validation data 

7. Course documentation / 



■ 1 

Specific Statement of tK)e Problem j 

The specific problem of this research^ wa^ to answer the ques- 
tion: Is't+t4^CAI Phonics Pro-am effective to the ^xteot that 80 per- 
cent of the learners attain SO.percent Of the/terminal critcrion^\ 

objeatives enilmer^ated below? • ♦ _ \ 

t - t ' ^ 

'1. The learner will name four prerequisites foi^ phonics * 

instruction. f 'x 

^ 2. The learner will icientify the' reUtltJnsh'ip.of each pre- 
requisite to phonic analysis.^ ' ^ ^ • 

3\ -Tf^ learner will identify the distinguishing quality of a 

consonant blend. 

*-•-<. 

• * 4. The If^rner will name each of the two-lej^er (r> X» s^) 
"consonant Blends. ^ 

5. The learner will describe the distingi/ishing quality of a 
- consonant digraph. 

6. The Jearner will name the seven consonant digraphs and the 
. single letters which represent digraph so^inds. ^ 

7. The Hearner will write one key word for each short voweil 
sourtd. • - • " . 

•■■ c ■ ,r > ' ■ : 

8. The.leai^ner will correctly syllabicate two words ^Hcl give 
' the* svllabication rule*for* each word* 

9* The learner will state the compound generalization for 

•short vowel sounds in one-syllable words. * 

10. The learner will identify ^ach instance in which y stands 

for a vowel sound and name the* vowel sound represented in each 



•instance* 
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M\ Tlle'learner wiy name the instarj^e in which w stands for 
a vowel sfi^urld and describ1?^e vowel sound which remits. 

12. ' The learner will Write ^a one-syllable key word for tKp ^ 
long SQund of each ,vowel, 

. *13* -^The learner will stat'^.in writing the "final e" 
generalization. . * / 

'04.yThe learner will state "^in writing the "single, f>kial" 
vowel general rzati on for long vowel souad^. V • 



15.*^ The learner will write the "adjacent-vowel^eneralizatlon." 
^ 16. The learnei^will rwnle'the six "regular vowel digraphs" 
that complete the modified "adjafcent-vowel generalization" wMcJi_ ' 
a'ppii^^to thase reglSfar ^igraphri^ ^ " 

IX The learner will desdr.ibe the distinguishing quality of a 
vowel diphthong. ^ ' 

ns. The learnej[;^wil"[ describe the distin^isliing quality of a 
vowel digraph. * * 

' / V 

, ,19. The Isar^ei^ill name the four common diphthongs and Write^* 
a key word f\lust<^|ti|tgv.tlie diphl^bngilound of each combinafioh.^ 
20. The learner wili state^the rule\ covertfig at^least sixyof 
these letters— £, gn, w, Jh, X, t^ and b when the^e lettei^ are 
not sounded in words. ^ 

,21. The learner will state the generalization for hard and 
soft sounds of £*and £. , . \ 

22. The learner will w^ite one word in which stands for its 
most common sound. 

23. The learner wtll nawie the yovte} letter that accompanies a 
in order foif £ to be sounded in a, word. 



. • 11 

24. The learner will describe the "schwa" sound and nime thet 
syllable 'in which the "schwa" sound occurs. 

25^. The learner will tell how and when r affects vowel sounds. 

26. The, learner will correctly label oo sounds in words. 

27. The learner will write that §1, aV[, aw, and au record the 
same sound. 

28. The learner wi 1 l^^&eScribe the change in the sound repre- 
sented by the letter i when !t is followed by nd^, 2h_, and Id, 

29. The learner will write a rule that accommodates^ the 
influence ot Jd^ on the sound represented by o. 

30. The learner will sequence the general procedural steps 
for introducing letter-sound relationships. This will be don<^ 
from mefnory, " , » , • 

31. The learner will arrange the phonic elements in an 
acceptable hierarchy for presentation to children, 

32. The learner will state from memory at least three* prin- 
ciples to be observed in teacluflfl^etter-sound relationships ""o 



children, 
9 

Related Purposes 

Though the specific objective was to determine whether the 
course met the preestabl ished validation level* other ways of assessing 
course efficiency were employed. One assessment dealt with the effec- 
tiveness of the instructional materials within the program. This 
analysis was undertaken to measure the difficulty levels of the incourse 
mastery items. The 80 percent difficulty level wasselected as a 
desirable level for measuring the efficiency of the instructional 
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materials in that it was compatible with the course validation crite- 
rion level. A mastery item and the' related practice and cueing mate- 
rials were judged satisfactory if the mastery itenj recorded a difficulty 

. ' ' . 

(the percent of students attaining mastery of the item) 'of 80 percent or 

higher. This analysis would indicate whether the Instructional mate- 
rials were reliable. • 

The analysis of pretest data was used as another measure of 
course effectiveness. If it cannot be proven that the course itself 
supplied the learner with the ^knowledge^ then the truejval idi ty of the 

course is questionable. Pre and postcourse data were c-ompared to see if 

\ 

the course changed the learners' behaviors or whether the^behav.iors were 
present without the course. 

Another way of analyzing the course was to determine the effec- 
tiveness of the instructional strategies and tactics employed. Th-is 
analysis was undertaken with no specific guidelines; however, the per- 
formance of the students was used to determine if the strategy was 
feasible. 

The course was also analyzed according to the percent? of the 
* 

learners meeting each terminal criterion objective. Even if a course is 
deemed valid, if the majority 0 the learners do not achieve each 
objective, then' the objective warrants investigation. The criterion c, 
80 was applied to the terminal test items. 

In order to fully evaluate the end product, the processes used 
in developing and operating the product w^re investigated. The opinions 
and views of the personnel who provided the technical support during . 
course development and course operation were, analyzed. 



/ 

The supplementary analyses can be viewed as related purposes of 
the study. These related purposes were to determine the full owing: 

1. What is the general status of the'^preservlce teachers' 
knowledge in phonics prior to the computer-assisted Phonics 
Program? 

2. Which incourse practice and cueing materials and mastery 
items do not meet the 80 percent diffj'cuJty level? 

3. Whi^ch criterion test itdas are not being met by the majority 
(80 percent) of the stiJdents? 

4. How feasible were the instructional strategies and tactics 
employed in the testing and instruction? 

5. How efficient were the authoring and technical operatii)ns 
for the program? 

Definition of Terms 

The following concepts are basic to reading this study and the 
related literature: 

Analogous practice . An activity similar but not identical to 
the final criterion activity, " ^ 

Branch . A generic term for the point of choice at which stu-' 

dents are-^sent to alternative 'frames within a program depawding on their 

responses to the particular branching point. "Responses may be to^diag- 

s ' 

nostic test items, in-program frames with multiple-chbice'or con-' 

. \ 

structed-response items, and so forth. The branch may take the student 
to a single frame (a remediaf loop) or a linear sequence dealing with 
his particular'needs. . ' 

r 
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branching intrinsic . A programming technique characterized by 
consistent! use of branching. < If after reading the information section 
of each iteiji, the student selects or makes the correct response to the 
question basdd on the materials, he is sent to an item presenting new 
Information. 1 1f he selects an incorrect alternative, he is sent to an 
item which provides information as to why his choice was incorrect. 
To the extent that the programmer has correctly predicted the possible 
response that the student population will make, the program taken by 
each student is under thecQ^ntrol of his own responses, and will dif- 
fer for students of differing abilities. 

Cue , A verbal statement providing the minimum information 
i^equlred by the learner .to perform the desired behavi^. 



Computer-assi sted instructi on . The operational definition of 
computer-assisted instruction is derived from the functions of the 
computer in this research project. Here, CAI is defined as computer- 
administered and computer-controlled instruction in which the total 
components of the instructional program are presented by the computer 
system. The interactions for learning are completely between student 
and computer. V The system presents the initial stimuli and urges 
learner responses. These responses are evaluated by the system and 
followed by feedback, reinforcement and evaluation. This particular, 
use of computer-assi sted Jinstructi on is labe^^d "tutorial." 

Criterion level . The criterion level is that preestablished 
level used to determine if the objectives of a project have been met. " 
The criterion level indicates what percent of students must succeed in" 



passing a certain percent of test Items In order to validate the 
effectiveness of the program. An example of a criterion level Is 
'this: ninety (90) percent of^the students must pa^ ninety (90) per- 
cent of the orltenlon test Items. 



Criterion-referenced test . A /:riter1on-'referenced test Is a 
test that Is deliberately constructed .to measure specified performance 
behaviors. The measurements are Interpreted Irv terms, of ^whether an 
Individual can demonstrate the specified behavior. There Is no refer- 
encing these fneasurements to other Individuals. 

Documentation . ^Course documentation Is the provision of fac- 
tu^and substantial support for statements made about a program. The 
program documentation Includes jit least t+ie following Information: 
number of persons tested, description of target population and Intent 
of program, minimum acceptable standards for validation and the per- 
centage of attainment of the criterion levels, the method used to 
validate the hierarchy, the results of that validation and the meah 
time for Instruction. 

m 

. Formative evaluation . Formative evaluation Is systematic 

evaluation In the; process of curriculum construction, teaching ana . 

♦ 

learning for the purpose of Improving any of the three processes.. The 
focus Is upon the a[l deration of a program during Its development. 
Formative evaluation is the collection of appropriate evidence durin^^ 
the construction and trying out of a new curriculum Jn such a way that 
revisions of the ciht^rlculuiir can be based on this evidence. * 
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Program . The total organization of all subject matter, 
strategies and techniques designed to achieve SRecifi^d levels of stu- 
dent performance In a major occupational speciality on a major task or 
skill area. ' 

4 

Summatlve evaluation . That evaluation that takes pl^ce at the 

' • J 
end of a period of Instruction In order to grade or certify students^ 

(" . ' 

on the unit, chapter, course. The main goal of summatlve evaluation ( 

> ~J 

Is to judge the overall effectiveness of each aspect of a program. 

Student records . The detailed records* ^paintained automat- 
ically by the computer, of a student's performance on each question. 
These records are stored on the log tape and are available to course 
authors'* for analyzing thei r, programs . . - 

Terminal behavior . < The desired learner behavior or end pro- 
duct for any one unit of behavior on Instruction. 

Validation . Validation provides information on the extent to 
which a program has resulted in the desired changes in theJ^ehavior of 
the learner. Validation for this project will determine whether 
students learning phonics content and instructional procedures via 
this-^program will acquire the terminal objectives as established by 
the author. The student's posttest score— his terminal behavior--is 
compared to the criterion level established at the -outset of the pro- 
gram. If the population meets criterion level the course is deemed 
valid. In short, validation Is ap experimental demonstration that the 



i 
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/inal version of a program does achieve its objectives as measMred by 
its criterion ins^trument , up to a certain standard of performance fqr 
a given population. ^ 

♦ • 

Delimitations of the Study 

1. This was a feasibility study which, developed, tested, 
revised, retested and validated a computer-assisted pro- 
gram in phonics for preservice reading teachers. 
* 2. The instructional program included selected phonics 
content. 

3. The major focus of the evaluation was formative. 
y 4. Provisions for individual differences in the construction 
of the learning environment included rates of learning and 
previous knowledge. 

5. T+ie subjects were preservice teachers enrolled in reading 
methods courses. 

6. The findings, conclusions and recommendations of the study 
are general izable only to the preservice teachers who were 
subjects in the study. 
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CHAPTER II ' 

REVIEW OF RELATED LITERATURE 
c 

Purposes for Review 

^ The research (question to which the review was directerf^ t^as: 
Cah this CAI phonics program effectively teach 80 percent of the pre- 
service reading teachers so that they can attain 80 percent of the 
terminal criterion objectives? ' ^ 

- The literature was initially reviewed to obtain data which 
confirmed the need for. teacher training in phonics and which supported 
the educational signif4cance oT the study. ^ 1^ addition, the litera- 
ture was searched for information about the suggested instructional 
alternative--CAI— in order to secure data regarding appropriate.^;ech- 
niques for implementing and researching computer-assisted instruction 
program?. 

These major sources were consulted in the literature search: • 

1. . The Reading Teacher , The International Reading Associa- 
tion, Inc., Newark, Delaware, 1950 - 1972. 

2. The Journal of Reading , The International Reading Associa- 
tijoh. Inc., Newark, Delaware, 1957 - May 1972. 

3. Reading Research Quarterly . The International Reading 
Association, Inc., Newark, Delaware, hall, 1965 - Summer, 1972. 

4. ' Educational Technology . Educational Technology Publica- 
tions, Inc., Englewood Cliffs, New Jersey, 1968 - 1972.) 

18 , 



5. Journal of Educational Research , Dembar Educational 
Research Services, Inc., Madison, Wisconsin, 1965 - 1972. 

6. Automated Education Handbook , (edited by E. H. Goodman), 
Automated Education Center, Detroit, Michigan, 1965. 

7. Pro grammed Instruction Guide , Northeastern University, 
Entelek Incorporated, Newburyport, Massachusetts, 1967. 

^ 8. Com puter-Asslsted Instruction: A Survey of the Litera- 
ture ,, (edited by A. E. Hickey) , Intelek Incorporated, Newburyport, 
Massachusetts, October 1968. 

9. Computer-Assisted Instruction: A Book of Readings , 
(edited by R. C. Atkinson and H. A. Wilson) Academic Press, 
New York, 1969. 

10. Index to tomputer Assisted Instruction , (edited by H.'A, 
Lekan), Harcourt, Brace and Jovanovlch, Inc., New York, 1971. 

\ 

11. 0. D. Barnes and D. B. Schrelber; Computer-Assisted 
Instruction: A Selected Bibliography , Association for Educational 
Communications and Technology, Washington, D. C, March-1972. 

In addlt'lon, technical reports on file from the major CAI 
Centers listed below were surveyed: 

• Florida State University, Tallahassee, Florida 
Harvard University, Cambridge, Massachusetts 
University of Illinois, .Urbana, Illinois 
The Pennsylvania State University, University Park, Pa. 

Stanford University, Stanford, California 

r 

U. S. Naval Acaderr^y, Annapolis, Maryland 
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Literature Divisions ^ -t • 

The review of the literature is reported in four section^. 
The first section' phe^nts an overviev/ of phon-ics in ^he reading pro- 
gram and information about teacher. knowledge of phonics. Section two 
focuses on modes of computer-assisted instruction and curriculum 
implementation procedures; Section Wiree reports cm selected com- 
puter-assisted instruction programs in high school / col lege., and 
teacher education areas. The final section looks at current vieWs of 
criteriion-referenced, measures. 

Time span of reviews . The literature dealing with phonics in 
the reading program and teacher knowledge of phoaics extends from the 
earliest issues of major reading, publ ications ta the present--roughly 
22 years. An inclusive overview was justifiable in that phonics and 
the histqry of the controversy about phonics are far-reaching. 

The review of the literature related to compu^il^assiste'S 
instruction covers not quite a decade. This- span, while seemingly 
limited, is the extent of the major time boundaries for CAI. Com- 
puters are no more than two decades old; the application of computers 
to education is>even younger. Hencfe.t the studies, theories and explo- 
rations regarding CAI were found in literature of the last decade. 

While criterion-referenced tests have been mentioned in the 
literature as far back as 1950, the coverage here is limited to the 
sixties and early seventies because it was not-uiitil that time that 
criterion-referenced testing was viewed from th^ CAI perspective. 

S 
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Phonic Analysis • ^ ' 

The literature on phonic analysis was reviewed to support ^the 
claim that phpnic analysis has emerged as an important learning tool 
for beginning readers. 

) 

I Current status in reading instruction . The literature in edu- 
national and psychological research abounds with reading theories and 
studies. Within the more narrow awna of reading research lies a 
plethora of far-dating and controversial writings about phonics. Not 
only has^honics been the topic of professional ifterature, it has 
also had continuing hej^days in popui^r lay media. 

What specifically is phonic??^ Phonics is the study of speech 
sounds and their printed representations. DeChant (1970) notes that 
"It [phonics] is the study of sound-letter relationships iit reading 
and spelling [p, 288]." Phobic analysis is the- process of arr*iving at 
the pronunciation of a word by '*sounding" letters and letter 
combinations. . 

Phonics instruction, the- teaching of letter-sound relation- 
ships, entered the classroom as early as 1912 and was then viewed as a 
"method" of teaching reading.. Numerous experiments pitted phonics as 



1 ' - 

vThe terms "phonics" .and "phonetics" are sometimes used inter- 
xhangeably; but they are not synonymous. Phonetics is the term used 
to designate the scfence of speech sounds (Cordts, 1965). Phonics 
(Cordts, 1965) is the applicati6n of phoretlcs to the art of reading. 
Phonics deals with the speech sounds ^nd the* letters that represent 
the sounds in reading. Throughout this review, both terms will refer 
to the definition given f^ phonics— the study of speech sounds and 
their printed representation^. 
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a method against various other reading approaches. Findings ranged 
Horn no differences^in acHyevement between groups ,to^ superior achieve- 
" ment of one group over the pther. s 

/ 4 Oyt of these early studies that covered more than four decades 

[1912-1955] came little that^was not debatable. Because of the Ificon- 
/ 

•^gruity of research findings, the status of phonics instruction fluctu- ' 
ated from a^lace of total emphasis in the reading program to an 
§ilmost excluded sta'tus. It was in this state of flux that phonics 
instruction found itself ,when the impact of Why Johnny Can't Read , • 
I (Flesch, 1955) gave phonics an impetus that was to last for years to 
come. The author of the controversial best seller contended that 
Johnny could hot read because phonics was not being taught in the *' 
schools. While it is obvious that .public inter,est was revived partly 
because of the emotional overtones of the publication, the interest 
was accompanied b> new insights and different perspectives of phonics 
instruction. - ^ ^ 

• Chall (r967) labeled the detade 1955 - 1965 as the period of • 
systematic-versus intrinsic-phonics. This period marked the metamor- 
phosis of the phonics issue from the earli^er controvSr*sy of "phoa|^cs 
or no phonics" to' "what and how much phonics." 

•Educators through the years have verbalized the change in the 
issues. Hpggard (1955) pointed out that a mere cursory examinati*^ of 



the professional literature ofri the subject of phonics would reveal 
that reading spectalists, without exception, advocated the , use of 
phonics ,in the teaching of reading. He pointed out that the prci)lem 
for the teacher was not whether phonics should be taught, but rather 
how it should be taught. ^ 
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stresses meanirig or with one that stressf^s learning t]ie codei 
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Years later, Ramsey (1963) contended that the issue oy,er the 
role of phonics in reading instruction was not whether phonics should 
be taught,' but ratfher how much and how early. Still later, Bagford 
(1971) reiterated the same ideas by posing these questions as the main 
foci of the present phonics controversy: 1) How should phonics be 
included? 2) What content should 'be included?*and 3) When should 
phonics be emphasized? 

Chall tl967)* summed Up ,the great debate in phonics, in this 
question: 'Do- chi Idren learn better yfi\h a beginning methoci that 

>? 

[p. 75]." She answered the question forthrightly : 

Here I .can say briefly that^^i would sdem, at our present : 
state of knowledge* that a^code-emphasis--one that combines con- 
trol of words or sperllin^g regularity, some direct teaching of 
letter-sound correspondence, as well as the use of writing, 
tracing, or^ typing--produce3 better results with unselected groups 
of beginners than a meaning emphasis, the kind incorporated in 
most of the conventional basal-reading series used in schools in 
the late 1950's and early 1960's. [p. 178] ' ^ j 

Sustenance was added to Chair s contention Jn research 
findings. Gurren and Hughes (1965) compared 22^ intensive phonics- 
taught groups with 22 gr^ jal phonics-taught groups. Tl« results 
favored intensive phonics in 19 of the groups^ three, gr^ps were not 
significantly different; no results exclusively favored gradual 
phonics. It was concluded fron: the subjects* performance on reading • 
comprehension and spelling measures that the gradual approach to 
phonics is s>gnif icantly less effective than the intensive approach at 
the sjtart of reading instruction. . ^ ' y 

Among those who opposed this early intensive phonics* jnstruc- 
tion in favor of what is teYmed the intrinsic approach to phonics 



instruction was Russell (19d3) whose research suggested that a moder- 
ate amount of phonics is helpful in learning to read and that a 
phqr>ics analysis program must be intrinsic. 

As in every debate there are those who advocate a truce. 
Winkley (1971) proposed an "intensive-gradual'' phonics approach which 
strikes a happy medium between the intensive and the gradual or 
intrinsic approach. WinKley delineated substantive reasons for her 
^recommendation and concluded that there is no logical reason that an 
analj^tical method, which has been termed a 'meaning-emphasis," 
"intrinsic," or "gradual," approach cannot and should not also be an 
intensive, systematic code-emphasis approach. Although it must neces- 
sarily be gradual in its introduction of phonics principles, this fact 
does not preclude an intensive attack on teachin^^the clues once they 
are introduced. 

Bagford (1971) favored th^ approach recommended by Winkley and 
urged synthetic emphasis in the beginning and then an early shifting 
to comprehension. 

Summary of phonics literature . Authoritative statements and 
research reports all support phonic analysis as an essential tool for 
readers. Phonics is one of the word analysis skills that aids a 
reader in gaining reading independence; for it appears that without 
proficiency in phonic analysis many readers will never master the 
higher level reading skills*. 

Teacher knowledge and training In phonics . Since it is a fact 
that phoQics commands an Important pUce in the reading program, it 
follows triat phonics needs to be taught well. This fact implies that 



good phonics teafhers are needed. Popham (1965) posited the axiom 
that It must be a necessary assumption of teacher. education programs 
that the knowledge, skills and attitudes acquired by a teacher candi- 
date during his preser;vice training will influence his subsequent 
teaching actions. Barnes (1967) beli-eved that the first requirement 
of a teacher is mastery of the discipline. He cautioned that nothing 
substitutes for subject-m^te^ Competence, rigorously developed and 
conscientiously updated, Durkin (1971) summed up the ideas of most 
educators as she pointed out that one cannot teach what one does not 
know. In addition, Durkin (1970) listed a teacher's knowledge of 
phonics, coupled with his ability to teach it to others as a definite 
contributing factor to a learner's success in phonics. She further 
alleqed (1971) that if a teacher knows the content of phonics he [the 
teacher] will not be burdened with many of the questions relating to 
how much phonics and in what order. 

Historically,. (Satis, 1964) teachers have expressed feelings of 
inadequacy about phonics instruction. As early as 1929 supervisors 
reported that teachers showed great uneasiness in teaching phonics and 
complained that there was an insufficient amount of material on 
teaching phonics in their teacher-preparation courses. 

Cordts (1955) became aware of the problem of inadequately pre- 
pared teachers at the outset of the phonics revival. She stated: 

It is not phonics that is being overlooked, but the teacher's 
inability to teach it intelligently. Students are being graduated 
from our teacher-training institutions without knowledge of the 
science of phonetics, or its application to the teaching of 
reading. It is little wonder then that phonics is among the most 
poorly taught subjects in thie elementary school [p, 81]. 



In close time proximity to Cordt's statement, Dolch (1957) 
hypothesized that ^ome teachers are opposed to phonics because they do 
not know any phonics themselves. Durkin (1971) discovered around that 
same time--1957--that her college seniors in reading methods courses 
did not know phonics content. She had supplied them with a prolifera- 
tion of techniques and strategies only to find that the students had 
no content to 'it into the techniques. She assumed that these limita- 
tions would not be present among experienced teachers; but, after ses- 
sions with them she found that she had misjudged their knowledge. The 
experienced teachers did not know phonics content either. In a 
national survey in which 603 teachers were administered the Phonics 
Test for Teachers , Durkin looked closely at the scores of the ?04 who 
were experienced teachers. She found these data: 

1. Eighty-nine percent could identify long vowel sounds. 

2. Eighty-one percent could recognize short vowel sounds. 

3. Only 29 percent could give explanations for vowel sounds. 

4. Ninety percent could identify the hard and soft sounds of 
c and £ but only nipe percent could describe the condi- 
tions under which they occurred. 

5. Very low percentages of correct responses were found to 
test questions about digraphs .and diphthongs 

Schubert (1959) also questioned the knowledge of elementary 
and secondary teachers in the area of phonics and structural analysis. 
He investigated the knowledge in this area of 80 elementary and 41' 
secondary teachers In order to answer the question of how much phonics 
teachers knew. He reported that many of these teachers did not pos- 
sess sufficient knowledge of certain basic principles of word analysis 



and inferred that such teachers offered minimal assistance to students 
who encounter words that are outside their Jthe childrens'] sight 
vocabulary. 

Farinella (1960) agreed with the assumption of educational 
authorities that teachers must have a thorough knowledge of a particu- 
lar skill before Ihey can successfully teach that skill to a group of 
pupils and appraised the knowledge of phonetic and structural analysis 
of primary and intermediate grade teachers from liberal arts and 
teachers collegas. Several variables--years teaching, degree held, 
number of reading courses--were correlated with phonics knowledge. No 
significant relationships existed between phonics knowledge and any of 
the variables. Farinella concluded that a majority of the teachers 
'tested showed a marked weakness in their knowledge of phonetic and 
structural analysis skills, ^ A* 

Aaron (1960) administered a test, to 293 teachers on eight 
principles of phonics that are ordinarily fought to childrer\ who are 
working with- basal readers on/second- and thT^^rade levels. Some of 
the examinees were experienced teachers; others were without experi- 
ence. All 293 subjects were enrol lees tn introductory reading 
courses. The group answered correctly 57 percent of the items. 
Though no standards were established, Aaron concluded that few 
teachers are well-groundedMr> the basic phonics principles. He 
believed his findings general izable to similar groups enrolled in the 
teaching of reading courses. 

The previously cited investigation by Austin and associates 
(1961) In the total area of teacher training inVeading reinforced the 
theory that teachers do not know the tech'riiques of phonic analysis. 



They reported that college supe>v-isors and cooperating teachers fourid 
that ^a lack of understanding of pl^ics principles was the greatest 
deficiency of student teachers reading. This group of experts rec- 
ommended that college instructors take greater responsibility in 

making certain that their students have mastered the principles of 

c 

phonics and structural analysis. 

r 

Ramsey (1962) sought' to determine the extent of the under- 
standings, skills and concepts of preservice elementary teachers in 
five teacher education institutions in t\ie midwest at the beginning of 
the reading methods course. An 85- item test 'was administered to the 
236 subjects. The results led to these conclusions: 

1. The common souijds represented by consonant letters were ^ 
known. 

2. Tl^ group was weak in diitermining whether^^JJie vowel sound 
in a word was long or short. ^ 

3. The group was weak in determining vowel sounds in unfami\- 
iar syllables, 

4. The group was weak in verbalizing the important principles 
of word recognition. 

Further confirmation of the collectivef^ concensus that teachers' 
phonius knowledge is inadequate is given by'Br'oman (1962) who investi- 
gated the factors associated with teacher knowledge of reading skiPs. 
-^Jhe phonics content needed by teachers in the classroom 'was determined 
from e grouping of skills common to ten basal reading series. From 
these skills, an instrument appropriate for measuring teacher 



knowledge of^ phonics was developed, it was found that a significant 
number of teachers showed a marked deficiency in the phonics skills 
they would have to teach if they used the basal readers, 

Spachd and Baggett (1965') commented on the seriousness of a 
teacher who^ lacks knowledge of phonics and syllabication. They posed 
the question of whether -teachers who do not understand the basic 
phonics principles can be relied on to teach phonic analysis well. 
The investigators hypothesized that the extent to which teachers can 
and do teach pupils various phonic analysis and syl labical^ion skills 
is dependent upon their own knowledge of the uhderlying principles and 
conventions, \ 

More recent Investigations of pre and inservice teachers* 

knowledge of phonics> sanctifined by replication, the findings of 

Schubert (1959), FarineTla (1960), Aaron (I960), Ramsey (1962) ,^ Broman 

(1962) and Spache and Baggett (1965),. Two reports by Ilika (1967, 

1969) dealt v^th teacher comprehension of vowel generalizations and 

differences in knowledge between males and females, respectively. The 

significant research question (Ilika, 1967) was: "How well do 

teachers comprehend vowel principles in relation to the utility of the 

2 

vowel phonics principles as designatjed in Clymer's research?" 

i 

The groups were comprised of geographically heterogeneous sub- 
jects with varying experience backgrounds. In the 1962-64 sample 
group, the subjects were all graduate students; in the 1965-67 sample 

•s ' ' 

2 

See T. Clymer. ''The Utility of Phonic Generalizations in the 
Primary Grades," in M. A, Dawson (compiler) Teaching Word Recognition 
Skills . Newark, Delaware: International I'-^ading Association, 1971 , 
pp. 83-89. ^ 



t 30 

group, the subjects were graduate^ students, undergraduates and 
seniors. The subjects were administered the Aaron Vowei" Phonics Test 
which measures knowledge of the principles related to soft and hard £, 
vowel sound modified by jr, vowels in open syllables, soft and hard 
short words ending in e, vowels in closed syllables, vowels followed 
by 1^ arid vowel digraphs. The percent of the utility of each princi- 
ple as determined by Clymer*s Investigation, was then compared to the 
percent comprehended by the teachers. The resulting evidence sug- 
gested that teachers comprehend the less userul vowel phonics gener- 
alizations more than they do the useful, phonics generalizations. The 
researcher (Illka, 1967) Inferred that If children are taught princi- 
ples of low utility, frustration and waste of time are likely to 
result, 

Fleming (1972) utilized a unique assessment procedure for 
determining teacher understanding of phonic generalizations. He pre- 
sented the 37 generalizations as they appeared in th? Spache textbook 
(Spache and Spache, 1971) and asked the teachers to respond with a 
word which illustrated the generalization. The specific objective of 
the study was to determine whether or not a systematic reHtionshIp 
could be established between the reported utility value of tW phonic 
generalization and a teacher's understanding of the generalizations 
wl.th teacher's understanding being defined as the ability to respond 
with a word which accurately reflected the correspondence or Intent of 
the phonic generalization. 

It was hypothesized that the greater the reported utility 
value of the generalization, the greater the likelihood for obtaining 
accurate teacher responses. Conversely, for lower percentage utility 
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^general izations,' the less likely teachers would be to respond with 
accuracy. The findings supported the hypothesis; however, Fleming 
concluded that although some experienced teachers appear to know the* 
phonics generalizations which are most consistent, it cannot be ' 
assumed that they know how to use this knowledge in teaching phonics. 
He also stated that the prospective teacher must have a secure under- 
standing of phonics generalizations before teach^ing these general iza-' 
tions to children. 

^ Seymour (1969) noted numerous misconceptions that are held an<l 
practiced by teachers in their teaching of phonics which further 
reflected the inadequacy of preservice training. Of particular sig- 
nificance to the preservice situation in phonics proficiency of 
teachers is the study conducted by Taylor, Govatos and Lloyd (1971), 
They evaluated the impact and value of undergraduate reading courses 
as percei,ved by first year teachers. More than 67 percent of the 
teachers indicated that their preservice training in phonics and 
strdctural analysis did not prepare them to do a good job of teaching 
these skills^ ,These ratings implied that beginning reading teachers 
do' not feel qualified to teach phonic analysis to their pupils because 
they do not know phonics themselves. 

The plight of the inservice teacher who attempts to build up 
h?r background by studying independently is explained by Aaron (1966), 
He pointed out that -the process consisted of memorizing bits of infor- 
mation with little or jio actual application. He advocated a more 
functional approach such as having teachers take time to work through 
exercises similar to those used with children^ 



Ramsey (1962) suggested tl>dt even if the teacher, used the 
extensive plans for teaching phonics to children that are outlined In 
basal reader manuals^ the teacher will encounter difficulty unless he 
has a command of the skills. ^ 

While the Insarvlce situation reflects the quali^ty of preserv- 
1ce training, more direct testimony to the Inadequacy of preservlce 
training in phonics Is available. Plekarz (1961) criticized the 
global nature of reading methods courses. She saw them as dealing 
yylth reading in a general way rather than teaching specifiable skills 
or content. Teachers, s(he conjectured, have been Impressed with the 
necessity of 'teaching phonics, but they have not been taught the ele- 
ments of phonics. Phonics, she continued, is alluded to rather than 
taught. 

Summary of studies dealing with teacher knowledge of phonics . 
The studies on teacher knowledge of phonics revealed that teachers, 
especially beginning and preservlce teachers, do not know phonics con- 
tent and have not mastered phonic analysis skills. l)t is agreed that 
the teacher must know phonics content and the techniques of phonic 
analysis if he is to teach the reader this technique of vord analysis. 
Though some experienced teachers appeared to know more phonics content 
than inexperienced teachers, a teacher must have taught fiv6 or more 
years to learn an "acceptable" amount of phonics. Authorities concur 
that teachers should master phonics content and phonic analysis before 
going out to teach and that it is the responsibility of^the preservlce 
training program in reading to enable the attainment of'^such mastery. 
It was suggested that one functional approacfi to learning phonics 



would be to have the teachers work through and analyze words just as 
children must be taught to do. The major reason given for ineffective 
preservicevtraining In phonics was that there was so much to be taught 
about phonics that there was not ample time in which to, teach it. 

Computer-Assisted Instruction^ Modes< 

Since the^.principles governing computer-jissisted instruction^^ 
(CAI) lend themselves well to'^roviding indivii^ualized training in > 
phonics for preservice teachers, the literature was surveyed for the * 
ways in which thjs computer could be employed to teach in order to 
discern the most promising mode for teaching the phonics content to 
preservice teachers, * - 

Computer-assisted instruction (Bloom, Hastings and Madaus, 

> 

1971) resulted from the convergence of two technologies: programmed- 
instruction technology and computer technology, Computer technology 

I 

as it is now known is only a couple* of decades old. Although there 
are many different systems of CAI, the basic ingredients are described, 
briefly: a) A lesson to be tai/ght is analyzed into the essential mes- 
sages to the sludent; b) These messages are delivered through words, 
graphs, pictures, or any combination. Some messages may be auditory; 
'c) As materials are presented the student reacts to them by answering 
questions, working problems, identifying points on a graph or objects 
in a picture, giving examples, requesting more information i Or a 
chance lo review messages presented previously, and so fort|j^ d.) 
Depending on the student's response, the computer presents the next 
message in the lesson, additional messages, ideas given earlier, a 
review of earlier messages of additional "developing^' questions. 



Computer-assisted instruction (Klaus, 1969) is the general 
term used to iescribe applications involving continuous interaction 
between the student and the computer duhing learning. Computer-man- 
aged instruction (Klaus, 1969) is the use of electronic data^oces- 
sing equipment to supervise the sequence of instructional materials. 

CAI may be defined more specifically according to an identifi- 
cation of its activities, (DiCK, ^%9). There are five major instruc- 
tional modes of computer-assisted irTstructiun: drill and practice, 
tutprial, problem-solving, dialogue, and simulation. 

In the drill and practice mode, sessions are extensions of the 
procedures used in the conventional classroom instruction. Drill and 
practice materials can be prepared at several levels of difficulty. 

« 

The computer presents the materials to the student, examines perform- 
ance and selects appropriate meit^rial. The computer system presents 
the drill materials to the student; the student responds through the 
.terminal input devices.^ If a student's^ response is correct, he is 
informed; if it is incorrect, he is asked to try again. Cues are 
given to the student whose responses are wrong. If the student con- 
tinues to respond incorrectly, the computer provides remedial work 
through a branching program. As correct responses are recorded, addi- 
tional appropriate materials are presented. The drill mode (Klaus, 
1969) presents a functionally linear sequence of practice Hems. The 
content of instruction most readily organized into a drill format 
includes arithmetic, spelling, second language vocabulary, and other 
stimulus-response oriented content. 

In the tuterlal mode of CAI, it is the computer which does the 
original teaching. Curriculum materiails (Cartwright and MtUel , 1971) 

t ♦ 
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are prepared and adapted to thk system arfd then^ presented, to the student 
through computer interface devices. This mode simulates the master 
tutor engaging in an interactive dialogue with* an individual leafrne/. 
The tutor presents information, asks penetrating questions^ and care- 
fully analyzes the learner's responses to the questions. On the basis 
of the learner's demonstrated understanding or lack of understanding of 
a given concept, the tutor provides alternative courses pf instruction, 
remedial sequences of instruction or even enrichment material. The 
tutor can move a capable or weTl -informed learner througti^a course of 
instruction very rapidly. Similarly, the tutor can tailor a sequence 
of Instruction to meet the needs of a learner who is not ^s capable or 
does not have a good background or experience or preparation. 

The dialogue model, (Richardson, 1968) is likened to a question 
and answer session between a student and his teacher. In this mode, the 
conversation is guided by the computer within theHimits of the informa- 
tion that have been established from the instructional ma^terials of the 

> 

subject area to be covered. It is necessary to'specify limits to the 
voca.bulary that the student may use in his dialogue with the system in 
order to establish a f^inite frame of reference within which the dialogue 
Will take place, and fi)r which the appropriate programmed instructional' 
material can be developed for storage in the computer system. Then the 
conversation follows as closely as possible the natural content and the 
sequence of a discussion between student and teacher. 

The problem- solving mode is perhaps the most direct use of 
the computer irt the classroom (Richardson, 1968). Computational steps 
needed to solve problems are written into the computer in the form of 
commands. This list of commands comprises a prograrr/. Students input 



data and commands; ' the computer solves the problem ar>d outputs^t^the 
answers. Stolurow (1967) noted that the professor whose students use 
tjie computer to solve assigned problems needs to teach in the, same way 
he has taught in the past. The prot>iem sol virvg mode is readily 
achieved, provided the typical computational capability o. the com- 
puter is available and there is an electric typewriter, or some other 
display and response device, in two-way communicatioi;! with it. In 
addition, the student needs to know how to communicate with the com- 
puter and how to solve his problem. Each student must know a lan- 
guage that permits him to enter into the system-'both the data for his' 
problem and the steps which the computer is to take in working out the 
solution to it. ^ 

' The simulation mode (Hickey, 1968) is described as the use 
of the system to provide practice in situations that are similar to 
situations likely to be encountered in ttie, future. The computer 
responds just as the simulated 'product would react. In this mode 
(Stolurow, .1967J the instructional staff formulates a model of some 
real, or idealized complex situation such a^ the operation of a chem- 
ical plant or the management of^a company. With a simulation the 
variables are defined by the ^specific situation. A computer program 
has to be written to process the student's input so that meaningful 
information related to his actions comes out. The output is deter- 
mined by what the student does as compared to the model. In this mode 
the student uses his initiative in if*eacting to ^he system/ 

Stimmary of modeg for computer-assisted instruction .. The CAI 
system offers several modes for presenting and handling information. 
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The use of one mode does no?l|rec1ude the 'jse of another. A system 

may well employ an intermixing qf the types or modes discussed. It is 

usually found however, that one mode' is used |3redominantly because the 
» 

nature of the content t6 be accommodated adheres mor6 to the features 
of a particular mode 'than to another. The drill and practice mode 
appears most efficient for presenting stimulus-response material; the 
problem-solving mode is used chiefly to process technical problems 
in such areas as mathematics and chemistry according to a program. 
Thfc simulation mode is the*use of the system to effect situations 
wherein the learner must react in a 'logical manner. Examines of such 
Situations include a war, business management and so forth. ~^7he dia- 
logue Tnode is an Nopen-ended approach in chat the areas for investiga^ 
tion are made available to the student and the student asks questions 
about the topic at hand. The student learns what he chooses to learn 
for there is no, prescribed program. The tutorial mode is that mode 
iiVtfiiifh the computer presents, controls and sequences the information 
baseir on the individual student. 

o 

Computer Assisted Instruction: 
Course Development and Evaluation 

Because the objectives of this research project were to 
develop, test and validate a CAI phonics course for preservice 
.teachers in order to iietermine the effectiveness of the course, the 
literature was surveyed to find out how a CAI course is developed" and 
how it may be evaluated. 

The literature revealed"lhat a complete CAI course is taken 
thr^^gh at least' two cycles: the product, development cycle and the 
validation or evai^luation cycle. The steps in CAI development are^ 



illustrated in the first three reports. Information on and sugges- 
t1ons for validation/evaluation comprise the remainder of the section 

• CAI course development . Popham and BaJ<er (1971) divide the 
, product development cycle into seven stages. The first sta^e is 
called the "formulation stage" where decisions are made regarding 
. social utility, cost and avail aj)ility of competing products.. They 
established that the extensiveness of the product should be commeiisu- 
rate with the product *s importance and that there should be no com- 
peting products of high quality. Stage two— the "instructional speci 
fication stage"— deals roainly witfi objectives. It ^s during this 
stage that instructional olfjectives are spelled out and that prereq- 
uisite behaviors are identified. The researchers asserted that the 
objectives myst be stated in terms of post-instructional behaviors. 

The "item tryout stage'* is designated as stage three. Items 
which measure the terminal and other behaviors are administered to a 
group of learners typical of the target group. The test items are 
"tried out" to be sure that learners possess the necessary entry 
behaviors, and do not possess the termi'nal behaviors. It was man- 
dated that criterion tests be devefoped prior to the development of 
the instructional product; and it was suggested that the items should 
^ be first "tn'ed out" with a small number of learners' and later with a 
larger number. 

The fourth stage \% the "product development" stage; it is 
that stage at which materials are actually prepared for the learner. 
Several rules were prescribed for this stage: the learner should be 
supplied With appropriate practice during the instructional sequence; 
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the learner should be provided vitn knowledge of results; inflexible 
strategies should be avoided; and selection of the instructional 
medium Should be niade in light of the desired instructional objectives. 

Tne point at which the developed t^aterial s are used exten- 
sively with .groups of lea^^ners is labeled the "product tryout stage." 
Uuring this stage, the authors ruled that extremely large or extrefnely 
snail nunbers of learners be avoided when field testing, that the pro- 
cedures be verified as replicable, that data from field tests be effi- 
ciently sunmanzed and that the researchers in the field testing phase 
collect data rather than draw inferences. 

The "product revision stage" is that phase in which the 
results of the field trial are used to improve the instructional pro- 
duct. The revisions should be based on legitimate inferences from 
field test data which include terminal criterion data and in-course 
learner response data. ^ 



and Baker (1971) is the ''operations analysis stage." It is at this 
point that the product developer undertakes a systematic operations 
analysis of every completed product. This analysis would cover the 
strengths and weaknesses of the process and product. The analysis 
should then be transmitted to some central repository for subsequent 
examination. The statements on product development offered by Popham 
nd Baker Jiave been realized in the course development schemes of the 
two projects which are chronicled below. 

Walter (1965) outlined a course used to train experienced 
teacher^ to author CAI course modules. These steps were actually fol- 
lowed when the teachers developed the Individualized Learning Modules 



The final stage in product 
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to teach topics in chemistry, physics, mathematics, social s'tud- 
and foreign languages to high school students in Maryland. A 
lary of the procedures is outlined without discussion: 

A. Module Design [those steps involved in planning and struc- 
turing the basic framework for a module] 

1 . selecting a topic 

2. defining the terminal objectives 



3. constructing a learning hierarchy 

a. task analysis 

b. enabling objectives 

c. ordering objectives 

d. identifying entering behaviors 

4. developing criterion test items 

5. assembling an entering behaviors test and the pre- 
test/posttest 

B. Module Development 

1. devising and flowcharting the instructional strategy 
selectjing the presentation media 

3. writir/g the instructional sequence 

4. editing the draft and translating it to the presenta- 
tion media 

5. testing the module with a small group of students 
from the target population 

6. revising the module based on feedback from the student 
tryout 



ERIC 




C. Editing and Pilot Testing 

1. editing of .paper draft for accuracy, grammar, smooth . 
and logical flow 

2. translating to presentation medium by programmer 

3. editing on-line by author and programmer 

4. pilot testing with two or three students to discover* 
the major flaws; first major author revising based on 
student records 

5. trying out with small group of approxin.ately five stu- 
dents who work th|jough the course unaided; students 
record comments and the data from this group are used 

^ for last major revisions before validating and field 

testing 

Gillikin (1969) at the United States Naval Academy, reported 
steps similar to those followed in Maryland (Walters, 1965) in the 
Academy's CAI 1500 Course Development Model. The Model, applied to 
the development of CAI courses at the Academy, is four-phased. The 
first phase involves course def ini tionand organization where agree- 
ments on what constitutes the course and the scope of the course are 
reached. Terminal and Interim objectives are written; evaluation 
instrximents are developed;* prerequisite topics are written. After the 
terminal and Interim objectivas are sequenced, the course is divided 
into modules and the manner In which CAI will be employed is decided. 

The second phase--module development— constitutes the writing 
of course materials which include these kinds of materials: 
pretest 

teaching materials 
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diagnostic tests 
check tests 

drill and practice^exercises 
poscte-st 

summary materials 
Phases three and four encompass initial reviewing and testing 
of the materials. After the materials are converted to CAI format, 
entered into the computer, debugged and formed into modules, initial 
student testing takes place. Revisions are made based on perfonnance 
records. After the testing and revising, the course development pro- 
cess ends. Then the course is ready for the next necessary step: 
val idation. 

9 

Summary of CAI product development studies . The studies and 
sources dealing with CAI product development emphasize these as the 
major steps in course development: a) selection of topic; b) develop- 
ment of scope and sequence of instruction; c) specification of termi- 
nal objectives; d) development of criterion test items; e) development 
of course materials for the CAI system components ^ f) translation of 
course materials to CAI medium; g) course revision; h) pilot testing; 
and i) revising and retesting. 

CAI validation/evaluation . Though the term evaluation is 
often used synonymously with validation, the two terms^differ 
qualitatively/ In CAI course validation, steps are taken to determine 
to what extent the learning module or course does what it was designed 
to do. Evaluation generally refers to a comparison in which the 



results of the module or course are compared with results of instruc- 
tional strategies employing other practices, proce<^es or materials. 
Accordingly, the reports that follow focused on validation, sometimes 
referred to as developmental evaluation or formative evaluation, since 
the purpose of this project was to develop and validate a CAI course 
and no summative evaluation was intended. 

Brennan (1969) provided an overview of techniques used in 
formative evaluation or validation of instructional programs that 
began with use of expert opinion. Subject matter experts judge the 
appropriateness and correctness of program objectives, tests and con- 
tent; then preliminary testing occurs. From this preliminary testing,- 
the evaluator obtains data on program effectiveness with a small num- 
ber of students. Brennan found various suggestions regarding the 
tota.l number of students to use in the prelim'inary testing and he con- 
cluded that the recommended optimum number of students to use is about 
10, He pointed out that when a program has been tried on about 10 
students and revised after each student's responses, the program 
should woric satisfactorily with 98 percent of the students from the 
same population. 

Brennan (1969) also noted that there are no standardized try- 
out procedures, but that in general, the programmer and student go 
through the program frame by frame making notes of needed changes. 
After the Initial evaluation, the instructional program is usually 
field tested under conditions approximating those for which the program 
is intended. During the field-testing phase, a program is usually 
revised two or three times until the data indicate 'that the program 
has met the predetermined, cut-off points fffr validation. The number 



of students that should be used in field testing is unresolved accord- 
ing to Brennan (1969) as is the number of students to be used in the 
preliminary testing. However, Brennan's overview of the recommended 
numbers showed that from 15 to 30 students are suitable depending on 
the projected population Size. 

At least five different suggestions for validation criterion 
were reported: (Brennan, 1969) 

K The criterion level for validation should be 90/90 [Ninety 
percent of the students should attain 90 percent of the 
terminal objectives]. 

2. The criterion level for program validation should be 
80/90. 

3. A predetermined gain ratio should'be used to validate the 
program. The gain ratio is the ratio between the amount 
learned and the amount that could be learned. 

4. A modified gain ratio ^ould be used in program validation. 
The modified gain ratio considers the^student's pretest 
knowledge. 

5. An error rate of less Hhan 10 percent should be the crite- 
rion for program validation. The error rate is the aver- 
age percentage of errors on all frames for all students. 
The lower the error rate, the more reliable the course. 

The flowchart suggested by Brennan for program evaluation is 
presented on the following page: 

The next two validation plans were used in validating the CAI 
projects cited previously (Gilllkin, 1969; Walters, 1965). 



write the program in preliminary 

format for use with individual 
students 

'have an expert review the program 
for internal, predictive validity 



^ is the 
Program judg'fe<i to^ 
J)e satisfactory 

? 

^yes 



no 



perform. prel iminary testing of 
program with small number of 
students 



IS the 
program satis- 
factory? 

yes 



field test the program 
in intermediate format 



no 



Revise 



Revise 




no 



Revise 



put program into final format 



perform comparative testing 
(if any) 



Brennan, 1969) 



Fig. 1. Flowchart for program evaluation; (adapted from\ 
196QK . ) 



The purpose of the validation plan by Gillikin (1968) was to 
determine whether or^not the course materials written by the^*author 
and programmed by the technical staff accomplished the objectives of 
the course. Two types validation were achieved with the developed 
modules. Contetnt validity, the validity demonstrated by showing that 
an instructional program actually contains the information which it ' 
was supposed to contain as stated before course development, was based 
on expert judgment. The second type of validation, formative valida- 
tion, was based on criterion-referenced t^s^ing and the previously 
established criterion level for validation. If the CAI presentation 
did not meet the specified level for validation, the teaching mate- 
rials were reviewed and revised until the criterion level was obtained. 

These data were collected for validation and analysis: 

A. previous test scores (background data, SAT-verbal, SAT- 
mathematical, from the College Entrance Boards Examina- 
tions, rank in graduating class) were gathered for corre- 
lation with achievement and time to complete the course 

B. student comments 

C. date, sign-off label and total time for each student 
recorded at the end of each session 

/ 



D. student performance records for each student which ^ 
included: time of day, student raimber, course name, date, 

ep identiiiers, response identifiers, actual response! 

3 

response latency, counters and switches 
The validation data were processed ^nitially by extracting 
student performance records and placing them on a course master tape. 
The master tape was then sorted by module number, ep identifier and 
student number. All comments and all unanticipated responses were 
extracted and printed. The author then reviewed comments and 
unanticipated responses and revised and updated accordingly. 
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These terms are important to understanding the data gathered 

in the validation studies: a) Segment - a logical part of a course; 
b) EP Identifier - a label indicating to which frame, problem or ques- 
tion a student is to respond; c^ Response Identifier - an entry in a 
schertie which indicates whether the student's response was correct 
(ca), incorrect (wa), unanticipated (un), not given (nx), second wrong 
answer (wb), partially correct (cb) jind so forth. The response is 
analyzed by comparing it to the answer set (all anticipated answers, 
correct or incorrect that have been programmed into the course) and 
determining into which category the given response fails; b) Label - 
the name given to a small part of a course; such as a frame or 
problem, for the purpose f)f referencing that particular part of the 
course; Student Records - the information accumulated by the computer 
about a student's performance while taking a course; Counters - a 
storage area accessible by a course in which simple arithmetic opera- 
tions, such as addition and subtraction, may be performed; e) Switches 
- a storage area of the computer in' which can be stored a zero (0) or 
a one (1), zero indicating an "off" condition and one indicating the 
"on" condition, thus making it possible by loading a switch to know 
whether a certain point .in the course was passed, whether the student 
responded in a certain way, and so on; f) Response Latency - the jitfr&- 
tion of time between a presentation of a problemito which a student is 
to respond and the entering of the response by thV-Student; jt Mctual 
Response - the response that a studfent makes to a question or proBTem 
in a course; the actualanswer, what the student did, is recorded- 



Secondary processing of the validation data Incliided these 

1. Updsrting of data on course master tape 

2. Generating student response matrix 

3. Summary of student response matrix 

a. total questions tried 

b. total pretes^t questions correct 
c total posttest questions correct 

d, ratio of total questions correct to total questions 
tried 

^ ratio of pretest correct to pretest tried 

f. ratio of posttest correct to posttest tried 

g. percentage of maximum possible gain . 

ho rank according to total posttest questions correct 
1. rank according to percentage maximum possible giin 
j. number of pretest, posttest, check test and diagnostic 
1 tems 

k, percentage of students attaining a certain percent of 
correct posttest answers 

4. Item Analysis Chart 

a. number of persons with a particular question correct 
or wrong 

b. mean and stai^dard deviation .of latency 

5. Student' Progress Chart , 

a. progress by class session 

b. ^progress by time / 
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The validation sub-plan prepared by Coding (May 1, 1969) for 
'the Montgomery County CAI Project followed much the same procedure as 
that of the U. S. Naval Academy (Gillikin, 1968). This validation 
plan, as was the U. S. Naval Academy's, was concerned primarily with 
content validity anct criterion-related validity. 

The criterion levels for validation were established: 90 per- 
cent of the students Would meet 90 percent of the criterion test 
items. Tbe following data were collected and analyzed: time of d^^, 
student number, course number, date, ep identifier, response iden- 
tifier, latency time, counters, switches, comments, date, sign aff, 
label, and total time for» each student. 

In addition, two validation charts were generated. Validation 
Chart A had these columnar headings: ep identifier; number tried/ 
number presented; difficulty level 1 • number correct/number tried; 
difficulty level 2 - number correct/number presented; discrimination 
^index; maximum, minimum, mean and standard deviation for latency time. 
Validation Chart B was organized to contain these data: 

Number of pretest questions^ tried 

Number of posttest questions tried 

Number of diagnostic questions tried 

Number of instructional questions tried 

Percent of students 

Percent correct for pretest 

Percent of students ^ 
Percent correct for posttest 



Percent of students ^ 

*■ 

% « 

Percent correct for instructional 

R Pretest 

R Posttest* 

R Diagnostic ' ' 

* R Instructional , ^ 

Maximum 
Minimum 

Mean Total Time of Modular' Instructional Packages (MIP) 
Standard Deviation (S. D.) of Total Time on MIP 

From the collective data on the validation charts, the authors 
determined which posttest questions were below the criterion level, 
which revisions were needed, which questions were not being used and 
if criterion level for validation had been reached. Dcsumentatlon of 
validation (Walters, 1965)-was to include the number of persons tested, 
the description of the target population, the minimum acceptable 
standard for validation, the percentage of attainment, the method used 
to validate the hierarchy, the results of the evaluation and the mean 
time to completion for the module. 

Summary, of Information about validation stfdies . The vafida- 
t1on studies cited above suggest that^there are at least five principal 
considerations for course validation. These Include: a) establishing 
a criterion level for validation; b) selecting a validation sample 
typical of the population of concern; c) formulating a validation 
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plan; d) collecting significant val«idation data and; e) analyzing 

the data to determine if the criterion level for validation was met. 

< 

Comparative evaluation for CAI courses , the use of CAI in 
comparative studies remains an issue. Even during the inchoate stages 
of CAI development, researchers cautioned ^others about making com- 
parisons. This study focused on formative evaluation and tested the 
effectiveness of the developed CAI course for preservice teachers. 
Since, however, comparative CAI studies have maintained some promi- 
nence in the research ^literature, an overview of current views on com- 
parative CAI studies was justified. 

The education researdh question of the past which asks 
whether a particular new method results in more learning than a tradi- 
tional method has been criticized by Stolurow (1962) because the crit- 
ical factor of a representative sample of the method may not have been 
representative. Stolurow (1962) asserted that the real qi^estion is 
efficiency and not amount of learning. His feelings on comparative 
CAI studies are illustrated in his prediction that the comparative 
study will be expunged firom future research on auto instruction. He 
avowed: "My prediction and firm hqpe is that the comparative study in 
which a teaching.machine is compared with live teaching will become 
extinct [p. 521]." 

Brennan (1969) in his literature search for CAI comparative 
studies, found that a well-conducted comparative study is a rare 
occurrertce.. ye maintained that comparative testing is not essential 
for evaluating the effectiveness of a' program and that comparative 
testing very often produces meaningless rfesults. He holds the 



position that without dependable and acceptable cnterid of progrdm 
effectiveness, there can be little program quality-control; nor can 
there be any objective basis for comparing one version of a program 
with another version, let alone comparisons between different pro- 
grams. He cited these seven criteria for comparative studies: * 

1. prerequisite variables 

2. identical content, objectives, concepts, examples, illus- 
trations and learning activities 

3. optimum learning conditions 

4. unbiased criterion 

5. extraprogr^.m factors ^ 

6. matched or random treatment groups 

7. replication 

He suggested that comparative studies be used to answer ques- 
tions about cost, or effectiveness of particular programs in a given 
situation with a specified target population. 

Two fundamental criteria for comparative studies have been 
established by Feldhusen and Szabo (1969a) as: a) specification of 
objectives and use of the same objectives by methods being compared; 
and b) specifiable and reproducible instructional events. That these 
criteria were not met in.j^fevious comparative studies \\ implied in 
Feldhusen*s and Szabo's assertion (1969a) that the research is of poor 
quality and poorly reported. The reasoning behind the assertion may 
be attribute^d to the situation observed by Feldhusen and Szabo (1969b) 
that the unpublished literature dominates the communication among 



'•^esearc'-.ers and developers in programmed instruction (PI) and CAI so 
tnat ^ew things are published in scholarly journals of comparable 
copyri q^'.ted Sources. 

Walter (1965) viewed comparative studies which pit the results 
cf CAI against results of other practices, procedures or materials as 
feasible if based on sou^d research procedures. No specification of 
tnese procedures was made by Walter. 

In sp'.te of the mass of opposition, many CAI instructional 
programs are compared with traditional or ongoing methods of .instruc- 
tion (Feldhusen and S2abo/l969a) • At least half of the studies 
reviewed had as the major emphasis some Comparative evaluation with 
traditional instruction (Proctor, 1%9; Kromhout, Hansen and Schwarz, 
1970, Roid, 1971; Grandey, 1970). 

The so-called traditional research question may have main- 
tained some status possibly because, as Felcjhusen and Szabo (1969a) 

— / 

so aptly pointed out, the very thing which school people want to know 
how well the new method works In comparison with what they ar.* doiag. 

Summary o f information relating to comparative CAI studies . 
The literaturfi reveals that educators and laymen alike are interested 
in how well CAI cbmpares with 'traditional' instruction. CAI author- 
ities point out that few comparative studies which pit CAI against 
some traditional method of instruction fully meet the criteria for 
quality comparative stud^s. Many CAI authorities maintain that 
effectiveness studies should receive the emphasis in CAI research. It 
was suggested that the most significant contribution thagt comparative 
CAI studies can make is to compare the economics of CAI to CL 



Computer Assisted Instruction: * 
Research Projects 

CAI's effectiveness has not been investigated in all disci- 
plines with all learners,\ in all environments. There are however, 
many reports on developed projects which attest to the fact that 
computer-assisted instruction is feasible and effective. The CAI pro- 
jects described in this survey met two criteria: they dealt with sub- 
jects at the high school level or above; and they employed the 
tutorial mode predominantly. The projects are described in this 
order: 1) those whose main focus was developmental or formative; 2) 
those which employed both formative and summative evaluation. 

Developmental CAI projects . Mitzel, Brown and. Igo (1968) used 
computer-assisted instruction in a recognition course about malarial 
parasites to test CAi's effectiveness in teaching a technical medical 
subject. The scope and sequence of the course content were developed 
from the behavioral objectives of the course. The main objective was 
to enable the learner to make a diagnosis of the presence or absence 
of malaria after studying microscope slides containing thin smears of 
the oatient's bloods The instructional segments followed a tutorial 
fornj^t anjd were labeled stage discrimination^ species identification 
and discrimination and diagnosis from case history. A preliminary 
evaludtion employing 20 subjects was conducted at the National Naval 
Medical Center. Seventeen men and three women, either Navy hospital - 
men, officers or civilians, comprised the group. Three criterion 
teSfts were developed to assess the performance of the subjects at the 
termination of th9 program. In addition to the three criterion tests, 
in-^rogram performance recordings were collected on each student. 



Upon completion of the program, the three criterion tests were indi- 
vidually administered.. Student completion time ranged from four hours 
and 42 minutes to 12 hours and 39 minutes. The specific criterion 
level for validation was 90/90. The total mean scores for the sub- 
jects in the upper 90 percent of the group was: 

Test 1 78 percent correct 

Test 2 91 percent correct 

Test 3 90 percent correct 

Total 85 percent correct 

Reliability estimates were obtained for the three tests by the 
Hoyt analysis of variance technique. Tests 2 and 3 were shown to have 
reliabilities of 92 and .84 respectively. Test 1 was found to have a 
reliability of .51 

It was concluded that the present form of the program per- 
^ormed well. Discounting Test 1, the 90/90 criterion was met. One 
plausible explanation given for below criterion performance on Test 1 
wds that the photographs usedjn /the corresponding instructional seg- 
ment gave less information than did the microscope slides. 

The research design of the Investigation was devielopmental 
since the researchers felt it was premaiture to suggest a carefully 
controlled comparative study in which CAI is pitted against some "so- 
called" conventional instructional format. It was suggested that the 
course be taken through several "optimization'* cycles and heilce 
improve the te|ching power of the program. 

Computers have assisted in the instruction of instrumental 
music. Diehl (1969) explored the feasibility of computer-assisted* 
instruction for instrumental music by developing and evaluating a 
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course in intermediate level articulation, phrasing and rhythm for 
clarinet. Because of the newness of CAI, a feasibility, or develop- 
mental approach was chosen rather than a more structured design such 
as the comparative study. Diehl found that high school students 
learned efficiently through the CAI mode and that CAI seemb particu- 
larly well adapted for aural-visual discrimination training. One sig-- 
nificant feature of the program involved student, judgment in comparing 
his version with a model. The student heard a pre-recorded master 
model, played and recorded his version and then heard an instant com- 
parison of t ha model and his recorded verslurf^ If he felt he matched 
the model satisfactorily, he proceeded to the next frame; if he wished 
to hear the comparison again he pressed repeat. The student could 
also record his version again and make another comparison with the 
model. Diehl saw this feature as a valuable part of the learning 
experience. 

The criterion, levels were established for the respective 
checkpoints which were positioned thriJughout the program. If a stu- 
dent did not meet criterion, ^he was branched to remedial segments. * 
Since listening requires an attentive 'set whic^ may be jeopardized by 
momentary lapses, this position for in-course'^i terion testing was 
considered more suitable than other positions* 

Approximately 19 months after initiation of the project, the 
pilot trial with 14 pupils began. The students in the sample were 
high school clarinetists who were beyond the' beginning level. Two 
types or performance records were obtained: student-oriented records 
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gave chronologically ordered performance information for each student; 
course-oriented records listed information in the order of question 
identifiers. 

Student completion time ranged from sjx hours, 21 minutes to 
11 hours, 25 minutes. Diehl's staff constructed an item response 
analysis chart which indicated right or wrong responses. The actual 
frequency of attempts and number of errors for each item were shown on ^ 
another chart. Information on the course-oriented records for each 
frame included these items: course segment, student number, frame 
identifier, response latency, response identifier, date, time of day 
and frequency of attempts. Tables were generated which indicated stu- 
dent time in hours and minutes to complete the aural program. Revi- 
sits in the main flow of the course were made from the analysis of ^ 
^student errors. Questionable items were reviewed and in some cases 
deleted. At some points, thp instructional bloQ^ks weref completely 
restructured. Remedial materials were revised in the same fashion. 

Yens (1969) developed and evaluated a computer-based pure tone 
audiometer trainer. Research, findings revealed that the computer was 
effectiive in teaching students with varying degrees of experience to 
produce acceptable audiograms/ Seventy percent of the learners met 
the criterion of producing "acceptable" audiograms. A developmental 
rather than a comparative design was viewed as more suitable to the 
study. 

Hall, Riedesel, Suydam, and Trueblood (1970) field tested a 
program of inservice education in modern mathematics and mathematics 
teaching methods for elementary teachers in the Appalachian region. 
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The investigation was based ^on the widespread agreement that a crit- 
ical need existed for new methods of providing quality inservice 
mathematics Instruction. It had been determined that preservice and 
Inservice mathematics training programs were inadequate and was con- 
cluded that a computer-based program in modern mathematics was the 
best choice for accelerating the accessibility of quality inservice 
education for mathematics teachers in Appalachia, 

The target population consisted of teachers of elementary 
pupils in sparsely settled areas of Appalachia. An IBM 15G0 instruc- 
tional system was installed in Dryden, Virginia, Gladeville, Virginia, 
and California, Pennsylvania, in that order, to administer the com- 
puter based course to the teachers. This system was used during 
afternoon and evening hours to provide individualized instruction for 
the teachers, ^ 

Of the 444 students who registered for the course, 387 com- 
•pleted the program. The average completion time was 19 hours. The 
minimum clock time for the fastest students was 12 hours with the 
maximum completion tim^ being 56 hours. The "Test on Modern Mathe- 
matics,'' developed by the authors, served as pre and posttest crite- 
rion measures. The authors believed that the population of elementary 
teachers should be expected to achieve a mastery leveVof about 90 
percent after instruction, 

Students at the three locations increased thei" median 
achievement from approximately 50 percent to about 75 percent after a 
seven-week period of concentrated instruction via CAI. 
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CAI deveiopmental and comparative studies . CARE 1 , Computer- 
Assisted Remedial Edtication: Early Identification of Handicapped 
Children, was develo|yeu^Cartwnght and Mitzel, 1971) to prepare 
inservice teachers of regular grades to identify and adeouately diag- 
nose conditions m children which may adversely affect their school 
performances. The developers of CARE 1 maintained that the majority 
of inservice teachers had not had the opportunity to acquire adequate 
information about the possible deviations in behavior that influence 
learning. They further -contended that teachers need adequate informa- 
tion in order to make appropriate educational decisions. The course, 
deemed appropriate for teachers of all grade levels, was specially 
designed for preschool and e.ementary school teachers. The course 
development procedure included^.a) refining and expanding the course 
des.cription; b) specifyi^lg^ehavloral objectives for course segments 
and frames; c) ^Authoring of course materials; df preparing course 
material f^ the CAI system; e) testing and revising the course; and 
f) documenting the course. 

The CARE 1 course was initially tested bySta^ personnel to 
assure a smooth and logically flowing course. The first pilot testing 
was carried out with 15 students during the summe?^, 1970. These stu- 
dents were accompanied by proctors who recorded students comments and 
program "bugs." Revisions were made based on these students' comments 
and author analysis of student records. The second pilot group, con- 
sisting of 15 additional students, was assigned to the course in late 
summe>,^ 1970. The same procedure was followed far the second pilot 
group except that the students recorded their comments without the aid 
of a proctor. Two advanced graduate students were students in the 



course in the fall of 1970 and followed the same recording procedures. 
These students also compiled a detailed evaluation of all the segments 
with special emphasis on the objectives. 

CARE 1 is alleged to be a thoroughly documented course. This 
means that there exists a complete printed version not only of course 
content and strategies, but of other more specialized types of infor- 
mation. Course documentation information is in three sections in 
CARE 1. Section 1 cons*ists of representations of screen (CRT) dis- 
plays; Section 2 contains the coding section and Section 3 is a com- 
plete cross-reference table showing which audio messages, buffers, 
functions and so forth were used and where they have been used with 
respect to course labels. Other forms of documentation are a 400-page^ 
Handbopk and a course Syllabus. The Handbook contains detailed sum- 
maries for each chapter, a 350-item glossary of critical terms and a 
comprehensive course outline, The^yllabus contains a description of 
the purpose of the course and an outline of course content and 
objectives, 

CARE 1 was evaluated }n two ways: formative evaluation for 
program development was followL^d by summative or comparative evalua- 
tion. During the formative evaluation, professional consultants 
reviewed the course. When the course was deemed operational, pilot 
groups were used for testing and revising the course. The second 
evaluation (Cartwright, Cartwright and Robine, 1972) was summative. 
During the winter term of 1971, all students (N = 114) enrolled in the 
course Education of Exceptional Children (EEC 400) at The Pennsylvania 
State University were randomly assigned to either of two conditions-- 
computer-assisted instruction or conventional instruction (CI). 
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The CAI group (N = 27) received all instruction by means .of 
the IBM 1500 Instructional System and did not attend classes with the 
CI group. The CI group (N = 87) received the conventional lecture- 
discussion method of instruction and met three drfys-per week in 75 
minute sessions for ten weeks. All students were enrolled as'.regular 
students for three credits feoth the CAI and CI courses were designed 
to enable students to achieve the same objectives. The instructor of 
the CI group was an author of the CAI course" and helped to plan the 
structure and the objectives for the CAI course. 

The data (Cartwright, Cartwright iind Robine,, 1972) indicated 
that the students instructed by CAI obtained a irean score 24 percent 
higher on the criterion test than did the CI studtnts. The differ- 
ences between means of scores on the criterion test was significant 
with p < .001. On the average, CAI students completed ttie three-credit 
course in 12 hours less time than the time (37.5 hours) scheduled for 
the 01 students 

A CAI de '61 opmental -comparative study was undertaken by Ehlers 
(19690 with social work students. Ehler's first goal was to test the 
feasibility of CAI for teaching prerequisite behavioral sciences 
knowledgeo Programs were, written- in sociology, psychology, child 
development and Freudian concepts. Faculty member*^ in the areas 
reviewed the programs. The feasibility st6dy resiilted in programs 
which were used with 113 first-year students in 1967. These students 
agreed that they remembered- the facts that were reinforced in CAI. 

In September 1968", an updated version o# the program was used 
in a comparative study in which one half of the group was instructed 
via CAI; the other half through regular instructional techniques. An 
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analysis of variance was used to test the assumption that randomiza- 
tion divided the student body Into two comparable groups and that 
there was no Initial significant differences between groups. While 
there were no statistically significant differences between groups, 
mean gain scores were higher for the CAI group on all posttests. 
Ehlers believed that the trend of higher CAI group scores Inferred 
^ that with future CAI groups there would be posHlve statistically sig* 
nificant differences, given that more instructional time was allowed 
and Imprcved programs were available. 

Sunnary of CAI studies c Computer-assisted Instruction has 
proved effective in a wide variety of content areas at the Mgh school 




of exceptional children, mathematioc, medicine, curriculum, physics, 
psychology and chemistry. In those courses which concentrated only on 



course effectiveness, CAI proved effective at the ddsired 4ev€l , for 
the most part. In those studies which compared CAI ^ith another mode 
of instruction, CAI proved either more effective or just as effective 
as the alternative mode of instruction. With most of the courses, 
developmental steps -sUftilar to those suggested and followed by Walters 
(1965) and Gillikin (1969) were employed. Courses were first devel- 
oped and tested for effectiveness. Comparative evaluation, if any, 
followed only after effectiveness was proven. 

Criterion-referenced Measures 

and CAI \ 



The one point on which CAI spokesmen agree^ without exception » 
is'that criterion-referenced measures should be xised to assess learner 





These areas include music, audiology, education 




achievement in CAI courses. Because of the umversanty :t opin^jn 
toward criterion-referenced me^isures for CAI the current literature 
was surveyed to answer these three questions: 1) How are criterion- 
referen/ed tests developed? 2) What statistical indices are appropri- 
ate in evaluating criterion-referenced measures? and 3) What are the 
relevant attributes of criterion-referenced tests. The answers to 
these questions were needed to provide guidelines for the researcher 
in incorporating criterion-referenced testing in course development. 
Today, commercially available standardized tests, with few 
f exceptions, are norm-referenced; they measure inter-individual differ- 
ences in achievement. The changing trend is voiced by Alrasian and 
Madaus (1972) who alleged: 

The last three or four years have witnessed a growing interest 
in criterion-referenced measures, particularly in the classroom 
context. The i/iterest is predicated upon a series of trends ^ 
occurring both inside and outside education [p. 2]. 

^ Most significant among the trends which stimulated the inter- 
est in and use of criterion-referenced measures has been the growth 
of instructional technology. Norm referenced tests did not meet the 
Instructional technologists* needs for evaluating either individual 
performance or program effectiveness. Consequently, an instrument 
which used program objectives as performance standards had to be used* 
The criterion-referenced test was that ^instrument. 

Alrasian and Madaus (1972) described the conventional steps in 
implementing criterion-referenced measurement as: 

1. develop, prior to instruction, a list of terminal behav- 
ioral objectives in performance terms. 
# * 
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2. set a standard for each objective as well as a standard 
for the complete set of criterion behaviors. 

3. devise situations which allow the students a chance to 
exhibit the desired behaviors. 

Certain implications for criterion-referenced measures with 
respect to variability, item construction, reliability, validity, item 
analysis; reporting and interpretation were made by Popham and Husek 
(1969). The implications are listed without discussion: 

1. With criterion-referenced tests, variability is 
irrelevant. 

2. The item must repn^ent the class of behaviors delimited 
by the criterion. 

3. The typical reliability indices of internal consistency 
are not appropriate for criterion-referenced tests. 

4. The most suitable type of validity for criterion-refer- 
enced measures is content validity which is based on care- 
ful judgment of the tests' apparent relevance to the 
behaviors legitimately inferred from the behaviors 
delimited by the criterion. 

5. For criterion-referenced tests, an item which does not 
discriminate need not be eliminated. If it reflects an 
important attribute of the criterion, such an item should 
remain in the test» 

IBT^When reporting and interpreting an individual's perfo'rm- 
) ance on a criterion-referenced test, group-relative 
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indices are not appropriate. In criterion referenced 
reporting, it is sufficient to report whether or. not the 
learner has displayed the desired criterion behavior. 
7. In using criterion-referenced measures to make decisions 
about treatments, the best course of action is to employ 
a number of schemes in reporting the groups' performance. 
Popham (1971) in an effort to identify useful indicators by 
which a criterion-referenced item writer could judg\ the adequacy of 
his test items, concluded that the goal of the criterion-referenced 
item writer should be for his test items to accurately sample the 
range of criterion behavior which the items have been designed to 
measure. 

The approaches to developing such test items have been labeled 
by Popham (1971) as 'apriori' and 'aposteriori . ' In the apriori 
approach an item form, which constitutes a complete set of rules for 
generating a domain of test items which accurately measures a particu- 
lar objective, is used. The aposteriori approach is viewed as the . 
alternative to the apriori approaches. In the aposteriori approach, 
the test items are developed around whatever generation rules are 
available. The items are then "tried out" to discover empirically 
which items are not congruent with the criterion. Those items which 
are defective are eliminated. 

The state of the art of criterion-referenced test development 
and evaluation was articulateLd by Jackson (1970): 

It appears that at the current state of the art it is 
difficult to develop the objective procedures necessary for crite- 
rion-referenced measurement of complex behavior without doing 



violence to- measurement objectives. What is needed for complex 
domains are item generating rules that perpiit generalizations ot < 
practical signifiqance to be made [p. 14]. < 

The statement implied that for the moment, until explicit 
models for item forms are stated in measurable terms for criterion- 
referenced test development, a degree of subjectivity in test con- 
struction- will. prevail . ' 

Implications and Conclusi on£N . 
from the Literatur'e ^'"---^ 

Phonics instruction and teacher knowledge . The literature abouf) 
phonics instruction, teacher knowledge and methods courses in reading 
implied or led to these conClusionVi 

1. Phonic analysis is an importan^component of both beginning 
and on^going reading instruction. 

2. Teachers, both pre and inservice,. show some deficiencies ht 
their knowledge of the phonics program. Specifically, teacher 
knowledge is lacking in these areas: a) voweV sounds and princi 
pies; b) consonant blends and digraphs; c) vowel irregulari tiesi . 
d) consonant irregularities; and e) strategies for teaching 
phonics. 

3. Teachers do not immediately learn the content of phonjcs 
and the strategies for teaching phonic analysis while teaching. 

4. Many methods courses in reading have not adequately pre- 
pared teachers to teach phonic analysis. 

5. Teachers should know the total phonics program if they are 
/ to make wise decisions regafrding what to teach, how much to ,tedch, 

and for which learners phonic analysis^ instruction is most 
beneficial . 



'eacner'-, readily adnt their 1 m-^i tat i or^s in pnonics and 
»'ccoa^ ^ze p^orics as a'^ integral part of the reading program; Vey 
a'^e willing to learn the content and instructional strategies and 
rrmciples tnat will enable then to do bette»^ jobs in the 

clacjsroo^. 

Lonput er-assi ste d i nstruction The survey ol' the literature 
conputer-assisted instruction led to these conclusions: 

i. - quality prograr in conputer-assisted instruction is the 
product 0^^ a creative and infomed course author and instructional^ 
prograrner , 

CAI of fei s possibilities for efficiently individualizing 
instruction that are unparalled by other existing instructional 
iystens , 

3, The TO^t r**'fective md^ of fl for teaching teachers 
phonics cdt'.nt and instructional strategies is the tutorial mode 
in whicn the computer imparts the information, guides the 
learning and does the evaluation of the learner's performance. 

4 A well -developed computer-assisted instruction tutorial 
program follows a set of developmental procedures which Include: 
a) specifying terminal criterion objectives; b) developing crite- 
rion test items; c) authoring course materials and translating 
these .naterials to the CAI medium; d) edging and revising course 
materials; e) oilot testing and revising; f) retesting and 
revising; g) validation; and h) documentation. 

5, The following data are important in documenting c^^Orse 
validation: a) nuinber of persons tested; b) description of the 



target population; c) the fmm'num acceptable standard set for 
validation; d) the percentage of attainment; e) the method used 
to validate the hierarchy; f) the results of the evaluation; q) 
the mean tme for the module and h) a replicable version of the 
cour:>e content and strategies. 

5. In order to validate a computer-assisted instruction^ 
course, the researcher must establish a criterion level which mus 
be attained before the course can be deemed a valid and reliable 
course . 

7. The minimum criterion level for validation is 80/80. 

8. t^etween five and ten students should be used m: the 
testing and revising process 

9. A minimum of 15 students should comprise the validation 
group. 

10. The effectiveness of a CAI course is subject only to its 
-attaining of the preestabl ished criterion level for validation; 
comparison with other instruction ii unnecessary and adds little 
to the research in CAI . 

11 CAI research should focus on course optimization. 

Criterion-referenced testing and CAI . These conclusions were 
generated by the literature on criterion-referenced measures: 

1. Criterion-referenced measures are the most practical 
measures to use in determining student achievement in lomputer- 
asr.isted instruction programs. 

2. Conventional indices of validity, reliability and item 
analysis are inappropriate with criterion-referenced measures. 



3, The most reliable type^of validity for cr Kerior-refer- 
enced measures is content validity. 

4. Content validity in general practice is determined b> 
expert opinion of the course content, test items and objectives, 

'J. The criterion-referenced measure used in assessing learner 
ach^*rvement should be genera", ly developed prior to instructic^ , 
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Procedures 

The procedures followed in developing and testing the u-stfj:- 
tioridl materials ^or the conputer-assi sted phomc ana'^ysis course tor 
preservice teachers are sufmarized in tne following outline: 
Fornulatior^. and Instructional Specification Pnase 

1. selected a course topic for presentation via CAI 

2. defined the scope and sequence of instruction 

3. VN'rote terTiina! objectives 

4. developed criterion test items 
set validation criterion level 

3. Product Development Phase 

1. authored instructional materials 

2. edited instructional materials for accuracy of con- 
tent, consistency, gramnar and syntax, and logica! 
flow 

3. forwarded instructional materials to educational pro- 
gramrrier for adaptation to the CAI :>y$tem 

4. reviewed on-line materials 

b. revised by author and programmer as necessary 
C. Product Testing and Revision Phase 

monitored the progress of four students through por- 
tions of the program 
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2. nade first revisions as indicated by the data and cori- 
nents fron this first testing group 

3. five additional students, typical cf the population of 
preservice reading teachers, completed the on-lini- 
program; perfornance data and conments were collecteo 
for each subject 

4. nade second revisions as indicated by tne data 
u. Product Validation Phase 

1. selected available students fron preservice teacher 
population who volunteered to participate in the stuuy 

2. administered pretest via the compute-* terminal 

3. pi^esented appropriate CAI instructional materials to 
stut^en1:5 as dictated by pretest performance data 

4. collected and analyzed in-program performance data 
b. administered posttest off-line and analyzed posttest 

performance data 

6. determined 1f student performance met minimfum accept- 
able standard set for validation 

7. document'^d validated materials 

8. performed and wrote operat.ons analysis 

I 

Tne difcussion of u.ie outlined activities is-m two oarts: 
Part One covers parts A, B, and C of the outline and is an account of 
the planning, authoring, testing and revision phases; Part Two contain 
details related to the validation as outlined in part D. 



Part On e: Planning, Authoring, 
"testing and Pevising 



Planning. The first step m course development was to select 
a course topic for presentation. The topic, "Phonic Analysis: Con- 
tent and Teaching Procedures," evolved from the existence of the proL- 
ler^ as cited m Chapter I. Tne scope and sequence of instruction were 
determined based m part on research findings which identified the 
most useful phonic generalizations, m part from authoritative recor-- 
mendations on what phonics content teachers need to know, and finally, 
on the basis of the writer's own judgment and the conventional wisdo^*: 
found m professional texts. The resultant course outline is found in 
Appendix B. For purpose of CAI presentation the content was organized 
into seven segments. Tlhese segments were given the labels below: 

Segments 

« 

PhOni I Readiness for Phonics 

Phoni II Consonant Blends 

Phom III Consonant Digraphs 

^noni IV Syllabication, Single Vowel Letter - 

Sound Relationships 

Phoni V Vowel Combinations: Digraphs and Diphthongs 

Phoni VI Consonant Irregularities 

Phoni VII ^ Vowel Irregularities 

The scope and sequence were then used as the framework within 
which the course objectives were wi^^tten. In writing the objectives, 
the course author fallowed the practices and sucgestiot^s other ^pro- 
duct developers and stated the objectives as specifically as was prac- 
tical before course materials were written. The terminal obie^ .ives 
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paralled the scope and sequence of the course content and indicated 
the learning criterion that should be met. Modifications in the scope 
and sequence and the terminal objectives were made based on experience 
durinq the testing phases of program development. 

Criterion test items were then developed for pre and post- 
course objectives. The in-course review items were written after the 
development o^ the instructional segments. These review items enabled 
the learnt to evaluate himself during and at the end of each small 
instructional unit. Such evaluation served as a basis for further 
assistance or instruction as ne^^ded or desired 

After the pre and postcou^se criterion items had been written, 
the criterion for validation was set at the 80/80 level. This level 
means that 80 percent of the learners would attain 80 percent of the 
terminal objectives. This criterion level was viewed as satisfactory 
si«)ce' this was the initial validation trial of the program and because 
the level fell within t?tie limits of the suggested criterion levels for 
validation found in the research literature. 

Authoring. The secon*^ ^^jor step of course development was 
the authoring of the instructional materials. Before a unit of " | 
instruction was authored, several different presentation strategies 
and the available presentation modes were investigated- 

Few instructional segments were ''complete" after the first, 
authoring. The materials were sc»*utinized for logical organization, 
feedback provisions, clqsure, opportunities for student participation, 
branching provisions, and provisions far individual learning rates. 
Revisions the various instructional segments included changes in 



strategies, elimination of fnaterials, and adding information, Fol- 
Iqy^ing revisions, the authored materials were transferred to CRT 
author sheets,, audio sheets or image planning forms, . 

Once a unit was edited and judged suitable by the authorM't 
was then forwarded to the educational programmer who coded the paper 
rendition so that it could be accommodated by the appropriate CAI pre- 
sentation medium--'CRT, audio unit, image projector or .a combination of 
these presentation medta. These coded messages were then key punched 
on computer cards and loaded into the system. The cards were read by 
the computer and the authoi^ed materials were presented via the CAI 
ternilnal. Audio messages were recorded in tentative form to check 
their correspondence with the CRT text and the images were drawn up 
and placed In flip pads. These flip pads are simply three-ring note- 
books containing a copy of each image. The images are numbered ani^ 
correspond to numbers on a trial reel that is placed in the ir^ge pro- 
jector. As the course is being tested, the number of the image that 
goes with a CRT or audio message is show,i or. the image projector; the 
student looks this number up in the flip pad and sees the- copy Of what 
Is to later appear as tne final image. 

The information from the three presentation mediums--audic, 
image, CRT--was then coordinated to form a tentative but usable 
instructional segment. Each segment was developed in this manner. 

Testing and revising . After several segments had been devel- 
oped, they were presented to the first pilot or testing group. The 
progress of each student was carefully monitored by the author or 
a'^other proctor. Fach student was asked to conrtent on the materials 
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specifically with regard to items they thought to be vague, superflu- 
ous, contradictory, difficult, irrelevant, poorly constructed, poor 
in format and appeal, boring, tedious or uninformati've. All students 
resp^^nded to the segment frames on comment cards (see Appendix C) 
on regular 3 x 5-inch index cards. The students' comments were then 
organized according to the frame labels and revisions were made ^s the 
'data dictated. Revisions ranging from the correction of spelling 
errors to the rewrit\ng of complete units were made. Samples of cor- 
in^nts from the first testing group are in Appendix C. 

After the fir^t major revisi^ons ;Yere made, the five students 
comprising tjie second testing group went through the course. These 
students were directed to eval irate the course in much th? same way as 
the first testing group. Unlike the first group however, these st^- 
djnts received minimum fiioni toring. They were attended only when they 
requested assistance. The performance data of these students were 
collected and the second revisions were made accordingly. The revised 
course, includ^^g final aud^o messages and jmage reeU, was then n«de 
ready for the validation group.. ^ 

Prevalidation results . The students participating in the pre- 
lim^inary testtng pruvidod valuable corments and suggestions for course 
revision. Students in the first testing group were more 'critics" 
than 1earners--al though performance data were collected and reviewed. 
These students were directed to question anything that appeared in 
need of revision* Their suggestions and performance were the crux of 



the major revisions. The foUowing are illustrative of the change^ 
which resulted ^rom the first testing group's suggesiions and 
pert orfT'dnce : 

Introductory frames stating tne purpose of the pretest were 
wri tten . 

Several vague pretest items were rewritten. 

Loops were shortened for getting ..c the correct ans we r o r^" 
several supportive but non-cntenon related ite^^i. 

A tedious activity was removed from Phoni 1 

The exercises dealing with the illustrative lessons m Pnom I 
were completely rewritten. ^ . 

The performance task<^ in Phon^ II were changed from recogni- 
tion tasks to reproduction tasks so ^hat practice would he mdre i^- 
line with expected terminal behavior. 

Feedback for unanticipated responses was updated and coded. 

More p'^ovisions were made for optional review. 

Several superfluous frames were deleted. 

Reminders to take notes were inserted at each opening frame. 

Because of the nnajor course revisions and the m^any interrupt 

tions in course flow that transpired, the performance dat=i f«^om tht^ 

first testing group were not considered for predictive purposes, but 

were use^ solely for revisions. 

^The second group of students was on-line predominantly aj^ 

"learners," though they were advised to make criticisms and to conine^t 

\ 

as necessary. Performance data were collected and analyzed as pre- 

r 

dictive of the performance ct the validation group. Comments and 



records fron; the seccK^d group were also used tor revi^i^'jrr. thou/' 
rncjor revisions had been-made fron th$ first testing jroup, tfie 
autho'^'s reviews and the reviews of several interested parties. 

The students involved ln*►bot^ prelinmary tryoutb indicat?-] 
that the course materials taught theni phonics Tne students espe 
cidl1> favored the objectives presentee at the beginning ot the 
^nstructicnal segments and the sunmary of their pretest performance 
•ne chance to construct generalizations was another popular featurt ^ 
the course. Other features that drew^'TP^'orable responses mcludi-d * ' 
strategy of "cueing the learner" to the correct response [inducti.i ' 
rather than telimg him, the prompt feedback, the sel f -evaluation 
opportunities and the illustrative lessons. 

Several cf the instructional strategies epiployed in the 
Phonics Course are described in Appendix D. The prelimmaVy testin'7 
with the second testing group indicated that the course did teach 
phonic analysis and instructional procedures and principles. Each ot 
tne five studejnts m the second testing group met criterion. 

l-or t Two: The Vdl idat ion Plan 

The val idatj_on design The research design employed in ttii- 
study has bee.i described {Sparks, 1967) as the 'One Group Pretest 
Posttest Design." The design is seen in Figure 2 an the following 
page. The procedures m employing the design were to give the pretf't 
which measured the state of the group with respect to the cri tenor, 
tasks, administer the CAl Phonics Program and give the posttest whic^ 
measured the standing of the group on the criterion tasks after 
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treatment. The following charactenstics and advantages (Sparks, 
1967, p. 19) were features which rendered the des^qn suitable for thvs 
study* 




Treatment 



Fig. 2. One group pretest-pos ttest design. 

1. The selected group is analyzed by the individual student 

units of which it is composed. 
2 Only one group is studied and measured. 
3. Pre and post measures allow comparisons of the status of 

the g^oup after treatment with its status before treatment. 

\ 

Treatment . The validation group, consisting of 36 preservice 
teachers, took the CAl Phonics Course. Upon signing on to the course, 
students were taught how to use the CAI terminal, administered the 
pretest and branched to the appropriate instiaictional segments as 
determined by their pretest performance* Each student was given a 
summary of his pretest perfomance and an overview of instruction at 
the beginning of each instructional segment to which he was branched. 
After instruction was completed, students were so informed and then 
directed to the posttest which was administered off-line. 

The complete flowcharts for the pretests and for instructional 

segments are in Appendix E» The pretest flowcharts provide a graphic 
1 
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representation of the branching and decision processes based on pretjst 
performance. The flowcharts indicate to the reader the specific ques- 
ticns to which the student my be sent in the pretests, depending on ^he 
student's prior performance, and the performance criVerion for the ques- 
tion. The flowcharts provide a blueprint from which a researcher or 
teacher who wishes to implement the program might build upon. For the 
educational programmer, the flowcharts provide a graphic represwta tion 
of the use pf switches anch-counters . 

The instructional flowcharts provide the same information about 
instruction as the pretest flowcharts provide about the pretests. All 
computer-rontrolled instruction and student opfions^ are charted. The 
reader is provided a concise scope and sequence of the total instruc- 
tional program a^ well as a look at the several discrete instructional 
programs available to students. The computer-controlled instruction, 
based on the student's pretest performance, is indicated in the rectan- 
gular boxes that branch from the diamond-shaped decision boxes, 

^^^ "t^uj^ Analysis and 
Validation Data 

Numerous data are available from a group's performance in a 

CAI course. The data to be collected, however, are necessarily 

delimited by the research question and the purposes of the research. 

The major question pose i in the research was: Is this program effec- 

tive to the 3xtent that 80 percent of the learners attain 80 percent 

of the terminal criterion objectives? The purpose of the research was 

totdeVelpp, test^ revise, retest artb validate the Phonics Program for 

preservice teatfTiers. 



Data source . All data, with the exception of tne posttest 
performance and the operations andlysis data, were obtained d^rfeci.^v 
from the individual student records that are stored on a course -^a if- 
tape. Individual student performance was recorded per session, ^'l-v 
performance records include tne following information: 

Time of day Student number 

Course name Segment 

Date Enter Process (l^) i<ientifie' 

Response identifier Response latency 

Actual response Number of responses to EP 

Cumulative time on-line Counters 

Swi tches 

Specific data from the performance records were retrieved 
from the course master tape by using specially designed library 
programs. Some of the Ubrary programs were used to provide daily 
performance data; other programs were used for sorting data at the end 
of the course. 

P recourse performance data . In order to determine what 
instruction was needed by the student^, precourse performance data 
were collected and or^nized for individuals and for the group. I- 
addition to prescribing instruction, the pretest performance data 
provided a basis for drawing conclusions afcout pre-instructiora i pre- 
service teachers' phonics knowledge in general. The following data 
were sorted according to the specific pretest questions: 



* ' * • 

Pretest, number ' Specific question 

\ EP identifier " - Concept area * 

{ > . . \ ■ ■ • . 

1 Number of students Number of students branched over • 

• presented question an .instructional segment 

• these data "relating to the specific pretest questions were - 
organ'i'zed and reported on Form A seen in Figure 4 in Appendix F. 

Pretest performance data were also sorted^. J reported 
accclrding to the individual student. The data-'below were sorted from 
the master tape and reported on Form B shown in Figure 5 in Appendix F. 
. Student ID huiiber Number questions presen,ted 

- Number correct responses ' Percent torrect response,s" » 

■ . - '/ 
■ Weighted score in ^ - Totals- pretest time 

percent . *. 

• • N • , . 

;\ Pretest , summary data are reported on Form C shown ifi Figure 6 in 
Appendix F*-^ The sTjmmary data w6re analyzed without a library program 
and include tliese items: mean^ number of pretest questions correct, 
mean wej-ghted score in perfents, standa^ deviation o^ pretest scores.,^ 
and range of pretest scorek. 



' . Incourse item analysis data . In orjlfer'to determine the effec- 

tiveness of -partir.ular items\to which students responded during 

■ ' • • ' ' \ ■ ■ 

incojjrse i lis traction,' the following suihnary data on each'major EP 

'identifier were' requested from the master tape: , ' 

Segmenii " • « EP identifier 

Nuirt)er of students' Number correctly responding on 

presented EP f i rst try • 

Number incorrectl^ ' DifficMlty l^'evel of the EP 

responding on last try " « ' (ratiQ anfl percent of the fjumber 
, . • of students who got the item qor- 

Mean number of responses rect to the number of students who. 
td the EP * tried the item) y ' . 



Number .of students for Response, mode 

whom trie respo.nse latency ' ' 

was greater thati one ' 

minute ' \ ^ ^ 

Form D, on which the incourse item analysis data are recorded, 
.is shown in Figurfe-7 in Appendix F. - / 

The actua.1 responses tp eacn EP were al^o rMyested jn brde*^ to 
examine the nature of responses that had notrei^^^ti^npated and were 
correct in order to update the correct answer sets. / ,t 

Materials validation data . These data vfere collected to 
determirte 1f the courl^niet the*80/80 criterion level set for 
validation: . t ' ; . . ' ' • 

Percent correct responses on.posttest frort top 80 percent of 
• the group; • • *. - • 

^ Percent 0/ objectives obtained per percent Qf total validation * 
^roup (i.e.. 20 percent, of the students attained 100 percent of 
the objectives; 40 percent of the students attained 80 percent of 
the objectives). . / • 

The form for reporting the materials validation (posttest) data 

• * ^ 

is seen in Figure 8 in Appendix F.. In addition to answering the " 
research question. tHPposttest data were helpful in assessing the 

* • * 

efftciency of the materials related to 6ach. terminal criterion test item 
and the.item itself. . ^) - -> 

The percent qf studei^s getting each posttest question correct 
was recorded ibn TOrm F in Figure 9 of Appendix While there is no 
specific level for determining such effj^ciency. .tMI§ crtterion.estab- 
lished by the. researcher 'was 80 percent, that is to say.' each terminal 
cri terf dh item will be answened correctly by at least 80 percent of 'the 



group. 4f the. item 'Is not answered correctly by the designated percent, 
.the -instructional materi^s related to the item and the item itself will 
be reevaliuated. Summary data for pre and, po6tcourse performance an^- for 
studeiit on-line time, were placed 6h a summary chart to show individual 
syident pre and posttest .differences. These data were recorded on 
Form G seen in Figure 10 of Appendix F. _ 

The operations analysis . The operations analysisJwa^ carried- 
out to enable the resjarcher to look critically at the completed pro- 
ject regardless of the outcome of the validation study. This close 
scrutiny was undertakers to note objectively the strengths and weakr ' 
nesses inherertt'^in developing and operating the course. The operaV 
. tions- analysis was not performed according to any prescribed rulesi 
^.however, the principles cited below ^opham and Baker, 1971) were 
• observed; ' * ■ 

^. .1. Operations analysis* should be ' perfprmed at the 'conclusion 
, of all systematic developmerft of instructional products, [p. 1,58] 
2. The o^perations analysis' should be written and transmitted 
. to some centr^l^^'nepository. [p. 158] 

Operations analysis data .were gathered from the responses to , 
questionnaires filled out by each individual instrumental in the- 

» • *■ • 

development and/or operation phases 'of the program.- The individuals 

ihcluded the edi/ational prograinmeri the graphics «rtistjf the systems 

analyst, the audio specialist and the technical* support manager. The 

questions below made up the questionnaire: . 

1. What sped fie- operations did you perform in the develop- 
< - ment of the Phoni Course? » ' . » 
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2. Di<i you Experience any complications or difficulties in 

' ^ performing .these operations for the Phoni Course? If so, 
could you specify the task and the 4fift»culty? 
• - • < - - • . • .. 

3. Would' you make specific recommendations for improving the 
future performance of th^se tasks, or potssible wajfs of 
avoiding these complications? ' 

4., Do you have any general recommendations for* the -future 
optimization of this product? ' . 

5/ Old you note any T>ract1cQ« incorporated irv the operation 
. of this program .that you believe should, be jnaintained^ or 
^ .thaf you consider assets? 

Wten alN questio/inaires had been, returned, tKe .responses 'we ''^ 



analyzed for the operation's strengths and weaknesses a^ perceived by 



working personnel 



/ 
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/j. Analysis' of data . • Following the collection and'organizi^ig of • 
data, the pfimary analysis was perfpmfed tq determine Whether the 
validation criteriorj' had Ijeen. achieved. The data frtw the items - 
artalysi s /forms were thfen analyzed to determine i'f an/ criterion objec-p 
tives mte below the 80 percent criterion 'i.evel, tftd which Items and 
materia^^arrahted ceevaluition ^nd possible revisions. • 

The secondary analysts looked at the da^a ori' these forms^ 
^ 1) precourse data forms; 2) incourse Sta forms; and 3) operations^ ' > 
analysis fomk. • * ^ \ 

Criteriorr tests: \ ^ * \ 

Development > Scoring. Analysis^ C * ^ ^ 

, Pretest development . The pi^test wa^evelo<>ed to assess the 

-learner's knowledge of phonic analysis, and to serve as" the basis for 

. ■• 

branching tnto the instructional program^ Because of the manV. branches 
thit could logically result from test performance, allmlnistering th 
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pretest via tbe cproputer terminal was faster andinore afcciirate than 
• • V , ' / • • . • . > 

off-line administration. The pretest was developed from the specifica 

tion af the bettavioral objectives and on a concept-level contingency, 

tiierarchy. The'coiKept-le'vel contingency hierarchy is illustV'ated in 

these tbfee questions tba^deal with the short ^owel sound: ' 

,a) What is the same about the vowel sounds in these word^? . 

f ^ .[cupdap> [dollup] * {fedmip]^ [ilslep] 

y If the student did not assjgn the label "short vowel sounds" 

he^'was branched t6 the first question dealing With the next concept on 

the pretest, if ttie learner ^upplied the corregt label, he went on tp 

the question that follows: * . 

b) Put your earphones on to listen^. soifB wordiB- containing 
^ vowel saL!nds..,.the words will beJglven In pairs. Type one 
tof the mts 'fcom the pair whiclr could'se'rve as a key word 
for theUhort 3ound of each vowel Type the word under 
'the vowel letter whose short ;sound is heard. 

' I a. ■ e ; 1 0 ' ' u 

^-v^ If the.leacner. Identlf'ie.d the vowel s^nds»correctly, but 
could nqt<recognlze short voWel sounds in words, it^ws Inferred that 

\ he had problemsl with' auditory dijcrlmlnlftlbn or that^he "guessed I'V^he 

Isabel and would therefore not know the rule(s^ove"mtng the concept. 

If the learner did not tdfch^lfy eacfi'word in which (the vowel* sound was, 

• sfort. h9 was hwnched to tb« <f IrsPquestio^ denting with the next con- 

/ ■ ' ' r ' • ■ ' ' .-^ ^ 

^pt^n the next pretext section! , If he answered^icSfT^ctly/ he tias 

presented this task deaffng with 'the short vowel sound jjenet^lizmon; 

•/ * V ^l^tf^ phrases to construct the genecaVizatlon l^or 

- ' V the vottel sounds In cat and Imp: Ih a word or ?y31able in 

' • which there is which _[ tb* word or sylla- 

' ' ^ ble, thtf vowel soMhd is short. ^ ♦ 
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- If the learner aosweVecf'all three questions correctly^ the 

" • . .. , X . 

.• program branched hiln over instr^jjction dea>ing with short vewel sounds . 

He wa«, hc(f»ever, given 'an opportunity to review that portion of 

'in-formatfon once.h's instruttion began. He wa§ a+so sent into the 
* " ' • ^ . . ' .. ■ ■ . 

iUustratVve lessons dealing with short vowel sounds. \ 
'■ ' * ' • ' ' ^ - . \ 

^ . > , ^The itio^fi quest1oi^5 •a learner correctly answered \r\ his jJre- 

test, the less instruction he received; thfe fewer pretest questJons 
^answered correctly,^! he tnore in«tructiW received. The contingei\pV 
hierarchy saved thme^for. the student 'wfra did not demonstrate the 
necessary knowledge to' li'anch over .instruction |n a respective airea by 
^ not presenting him with items, above the difficulty level of any pre- 
ceding one which the s^dent" couldv^not answep. Th'e hierarcl^i/i tjie 
pretest enabled the student who possessed the*no]wle^s to' demon- 
strate them^nd be exempt from .super/ Iaiou^ 'nsfruotion or pracjw.ce.- 

he' pretest ftem^ may be. classified as the, se lection 'fir -com- ^ 

pleti6n t>De (Remmers, 1965) in that the learners sel^^cted th6ir • - . 

• .e- • * 

answers from among given alternatives of filled in blanks to compleie 

statemefitsr^/5i.nc4 a review of' thfe ^literature -^evea led 'that relia- •» 

, bility data mtf^^Jitt'le or no contt-ibution to criterion-referenced 
* • 't^- • / ' - -. ' " 

tests, the content validity of'tl^t^st ftems i*as de.ten»1ned by 

/ • - 

. judging compatityiHty'-of thTtest itertls^^i^h the behavioral » 

objectfvesV- . ' 'j-' » ». i 

\ - V< ... .-.' V 

Posttest.aevglopment . . The^ttgst questions were, for the 
most part, the ^upj^y tjipe'(Refflm6rs,;i§65))' the learner supplied 'alt 

component^ of tlie^ answer to'essapEJ^JT^ short answer HueUHWs'. ^ ' 

' *' ' - • ' »J * * "'t "1 ' ' * 

^;rhis type ^response war? evaluated off- Ijnerjff^r than by-the. tompute*'* 



system because the system is limited in its ability to evaluate and 
process constructed, wholerline responses which may be stated cor- 
rectly in numerous ways. Too, it was felt that ^he learners would 
have mdre freedom in the way they answered If answers wgre evaluated 
off-line. The posttest questions were more comprehensive in that one 
posttest questt^n may have been designed to elicit five features in- 
one answer, where>^s the. pretest quest. on usually eTicited on>jtone, 
The p.re and posttest questions dealing wjth' readiness for phonic 
anaTysis are^ illustrative of »the differences in pre and posttest 
questions. V • • , ' • 

Dfr t^e pretest, these five items were used to determine if a 
learner* knew the- labels and th^-explanations-of the prerequisites for* 
''phonies' that^'w^re taaght in this course: • • 

- 1-. ; Directions :V Before' a chiltf can profit from instruction in 
phonic analysis, h« must have; acquired, certain skills and 
knowledges aad'developed certaln^abilities. Look at the 
U?t of skills, abilities, and knowfedges 'sho^n oo the 
i*age. type the number of eafh statement that is one of 



four prerequ1sit.es for p'honic aflAlysis: 

[^udents see^li St «n i*age.5GKn/an(L selects and types 
»■ ' it the numbers Bext-tO|the answers of *thefr choice] 

• . [students press ligftt pen to the answer 'of theiVchoice ' 

for the questions below] * 

2, To what dbes auditory <liscrimination. for phonics 'inftruc- 

' ' ''y : ' • ' . . 

. • , tionTe.fer?. ^ . .* • • 

- ' •. .* . ' . 

■\ .C " J [«bi<i^y to distinguish whole words in. dral form] • 

^ ( . ■ [ability. to distinguiifi sounds ifi a word] • • • * 
t * . [ability' to iiear. al.l spupvls in the spoken langua'ie]'. 
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3. To wn^ does visual discriminatjon.'for ph^nicS instruction- 

* • ^ 

. ' refer?*: 

• ; i ^ \ ' 

[ability to see .sfmilartties ind differences in printed 
/ letters] ' • *" 

"'' • . '* ■ . 
[ability to recognize printed letters] ' ^' 

't . ' . • • • - • 

[abilfty^to perceive ^the whole; word ^ a unit] 

4. Why does a child nefed to .know f'be letters of fhe^^^iriphabet 
by name and Shape *for phoni6s insuructidn? ^ ' ^ 

[to help^n identifyln^jcorrect. sounds] ' ' 

[to see that each lettef stands for a. particular sound] ' 
• I . •- - . . - 

[to facilitate T:brtniuni cation in the teaching-learning 
process] ^ • ' . • v •. 

. ^ . • . . / - . :-\:_ 

5. Why is the child's ability to recognize some -whole words* - 
in printed form itn^rtarit for phontCE instruction? 

[to provtde reffirence points for introducing J etter- sound 
relationships] ' . '. \ 

[to help the child un^brstand the ^oncj^pt^Bf a word] * 

[to facilitatecAil -teacher communication] . 

W ■ 

On the posttest, th^ pne question meatsured thrf same knowl-.,.,.^ 



'edges as the five pretest questions abov.e: . . 

" , * • ' *. ' 

^ Name the four prerequisites for phon^ic analysis and <Jiscuss 
each as.it relates to the teaching and learning of- ph6r^1c. analysis . 



^' - E\/ery leariier was pre*nted every polttest question. TUb pre 
-and postfest and the weighting scheme explained belpw-are in AppDsndix G. 



si Weighting and sWinq test ftems. Pretest items Ifere. usually 
KKftightedW C*-) point each because only one feature km present in 
each test ito«.' Ifa.se^ies of items, comprised the answer, ;t()en a 'W^J' 



. student had, t-o ^tt%in «t least 75 perce.nt of the items to receive the/ 
■full point value*bf ^her item. Fewer than .75 percent rendered the ff%m 
worth no p<iints. ' .* • ■ . 

• - The "Check-List Point-Scor^ Me^iod" -was pmployeH in weighting - 

»>njl^coring the short- answer ani essay question's on the posttest, 

J - • ■■ 

This^ scoring method (Remmers, 1965). required breaking up±hd ideal 
response to. the questiSn ihto a series ^of features or points. The* 

learner's anSwer was then evaluated with respect to each fearturfe and a 

; , ■ • . • - .V, _^ • _ 

point was awarded if the feature was present in the*1fesponse. Jhe- 
-features tested for In the posttest responses were the salne' features • 

^ * ; . 

tested for in 'the pretest. The pre and 'posttest weighting- schemes are* 

* • " • ' ' \ " ' 

given off tte pre and posttests. The features" for which poiibts were 

given in the politest .are underlineAwith fhe points ]n parentheses. 

• . Arriving at pertent for validation criterion . In or,der to 
validate the coyrse, the criterion- of* 80/8(^ had-y be met. Eighty 
*|]^rcent5 0f the learners had to attain a miniAum score of 74 of the bos- 
sible 52 points* for tJfe cpurse to meet the criterion level for valida- 

* • ^ • • • , • ¥ 

tioh. f The percent v^ilue perjwints was calcuNted so that a certain >. 
number of points woul^ be equal to 80 percent (i.e.,. 9 points = lo" per- 
cent; 19 points. = 20 percent; -47 point* ^ ^ percent). ^ 

, Course documfentation . documentation of the CAI course includes 

t*e compilation of information" about the developed, anci validated, cburse' 

materials a<railable from the DOCUMENT Proaram (i^tSf'19fO) developed 

at .The Pennsylvania State University. ^ 

Twprintaid documentation provides two sets of informations 
. • ." • • ■ ^ 

one set Is a concise and. accurate description of Jhe course; the other- 



is wHhin the technical arena and'deals with.prograimiing Tangujge and 
system functions. The course description consists of all 'possible CRT 
displays available td students and a description of answer processing, 
tach iFrame cjirries its label, irrdication. of pauses, character clescrip^- 
to»s. (e.g., apostrophes mean chat^actel- is alternate coded),ahj5 row and 
qolumn- in 'which the t^t begins. * -Below tfie screen display, the'response 
mode and tiine allotment for an^^swer .are indicate*: DOCUMENT then 
descj'ibes'tfie treatjnent fbr/eacK pos^4ble answer. Tfeatinent may include 
^ branching, bassjng.'to the nex^t frame, V«turnirtg to past instruction'. 
Us^ of al|ie^ interfa'ce devices—audio or image— is' shown -jjy ijj)ecial 
message's. Ahe jjescription is a sequential and graphical^presentatioi^ 
of a course. •. . * ' *• , - . . 



. 'Ihe set. of technical information provided by D0CUM6NT *1ncKides 

the actual Cours.ewrittfr^stateijjen^s (the programming language) rised in 

the course. In addition^ the headtng-'tfri^each page' notes the course 

name and segment, date. arid time Df diy of the bOCUMEJit Hin aiid the . 

pagination. The cfoss-refei^nce. table sfiows WhMch audip; buffers,'"'^ " 
. ' . • • . , 

-oounters, functions, film. Images, labels., macros, return* registers, ' .- 

switcfies, and counters used as switcheihaye been iised'and where. 
' ' *• . . " » 7 

The DOCUMENT -System, progranined^ln'pL/l for an IBM 360/67 

I*' • ••••V 

. ' System/ is compatible wlth^y 360 s^ystftff'containing 4 stantlard PL/1 
compiler. Oth^r documentatloh-data for the' Phoni Coucse include a 
description of instructlooal strategies^ flowcharts of ebch instruc-' 

tional segment, 'the EP i.dent4«er scheme*, the ^llstch identifier scheme 

. f ' 3*' • ' ' ' ' r ' 

; tnd the macro ana-dict.ionary u?e.' Complete coui^e documentation is in 

■ the central repository. In the (Computer Ajssl^ted ^instruction Laboratori^ 

at Tfe Pennsylvania SUteUnive^^HjiU ' ' . . . ' ' 



CHAPTER IV 



ANALYSIS OF DATA'AND RESULTS OF FINDINGS 



J»ie findings from the collection of* four types of data are 
* reported jjn^tVs chapter: 1) findings related tji^pretest performance; 
2) fi ndi nigs , related to in-course materials analysis; 3) Vindings . 
related to posttest performance and Crjiterion test items analysis, and 
4) findtngs from -the operations anaJyjis-. The- findings are reported 
under. the" Iwyidlngsrfan^l^ the ortier enumerated above and are prefaced* 
vfi.th the purpose fflr^vihidn those data were collectedly > < 

All performarK:e data', vnth-the exception of po^test data', 
originated 'from the individual student "records that, are stored on fhe ' 
course master tape. The data wQre sorted, collated and printed'from 
thycourse mas"\er tip6 by using special library pro'grams designed to 
■^lyze dati^at.T<he Pennsylvania State University Computer Assisted ^ 
•Instruction L'abo atory. Additional data • were .generatetf from W ^. 
printed listings*. ^ . . ' . 

)■•■'• 

elated 

rVbrmance Data 

' " > , 

The'roain objective Iti gathering ,-)reteft performance data was to 
' ■ *'. * , • 

appropriately branch a student'^to .Instruction bas^d on his prior knowl- 

edge of the* concept ^o be" taught^. Such branch1,ng wa« in line wlth the 

premises on wh^. computeir-assi sted Instruction, was built— that of 

Individualizing •Instructloh. In' addition to<*'prov1d1ng-a 'basis for* : 

branching, the* data froJh >Dr§test perfohnance were used to .report the' 

^ ■ ' ■ • ' » > ' ' ' • ■ <• • ' I, 

* ' .' ) , » ■ . • "r 



E^dlrtgs. Rela ted .o 
Pretest P'erf 



, general status pr^ervice teachers' phonics knowledge without »• 
• jnsVoictlon. , These data were a^mbTed from the. course master tape and. 
presented the following fnftormatfon: 1) total nuigber and percent of 
students presented anJ> corf^ctly answering each pretest questiojl 
(meeting criterion^. 2).'jpt51 number of students, branched over each 
instrpction.ffl segment;' an^ 3). total number of students branched over all 



^ ins'truction, ,._ ^ - ! 

, • • Individual^^tudeni pV-etest performance scores, werle listed In 
• order to. provide" the full range of pretest scores. .The number of 
minutes spent in the. pretest ms collected for. each, student in tftfder » 
-^r^p determine the ratio of time spent in the Vetes.t to that spent in' ' 

. H- A > a , ■ • ■• W ^ ■ 

instruction. t " . ' , , 

Findings: number arid percent oi^ students pres,er>ted and ' ' 

■ ■ ; correctly r espon^tng to pretest questions .' Table 1 contains the per- 

formance data for each pretest question. It was found that- 17 or 47 

percent of the students met c^riterion op^ the first' question- in. Pretest* 

K Of the >7 students who correctly selected at least three of the ' 

readiness factors-, 10 chose the appropriate answers'' which related at 

least three' of the readiness factors to" phonics' irtstruction; No studerft 

.achieved- a perfect score on the preffest dealing with readiness, for 

phonics. Nineteen,, or 53 percent of the students did- not meet criterion 
. \ . . , - 

' on The first pretest' question and^V'e therefore 'not presented 'the four 

related questions for t|iat pretest* i • " " ' 

- Pretest Z nfeasured the prese/vice teachers' knowledge of con- ' 
sonant blends^ Thirty-four. or 94 pircent op^e students recognized ' 
^ the examples of. consonant, blends Question 1 ) j' two 'or six-percent did 
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^ not'.- jOf.the 34 stadents who correctly chose the term consonant blend 
as tfie label, only sevep chose the. appropriate- descriptor of a con^o- 

• nant blend (questioh 2). The criterion for naming blends (question \). 

was 17/20. ^ Of the seven Istudents who .chose the appropriaXe desgciptor,* 

1 « jj« • • . 

two met criterion op question th.-ee of the second pf^test. 

^ ' I \ ' • - • 

Protest 3 measured the presrtrvice, teachers' knowlei/ge >Df go/i-^ 

i sonant (Jigraphs. Thirty-five or ^zWercent of the ;^udents recognized' 

'the example £h in th^^rd .phonograph as a consonant combinat^qg. Of 

'^is 35I three werfe able'to identify the combination «s a consonant. 

digraph (question 2). Qaiestion three askej thp 'students tc selectee 

' bett descriptor of the consonant digraph; all tHree 0/ the remaining 

students responded correctly. These ^ame three students were tben pre- 

■sfented question *4 ijh1chTequi red that they name^.the six h digraphs ,\ 

questioh five, the ck digraph, and question six, t^ie ng^ digraph. The 

composite crTterion for naming digraphs was 8/8. {leither of the stu- 

dent5 met 'the ctlterl^on; therefore, na^studfjit -feceived questions seven 

* • I 

) through -ten which required naming the single letters, which represerit 

the digraph sbunds. ■ * • * 

Vi ' ' . - ^ ' . • 

.Pretest 4 coiTsl^ted of ^thrft questions about short vowel sounds 

In words. The first question reared that the students select the 

^ label for the vowel sound In selected* words. Thirty-oije or 86 percent 

of the^reservice teachers iresponded.correctl/.'* The secorfd talk ^ 




(question 2) was that of selecting, from spoken p|t1rs of words, the 
word In whfich the vowel sound was short. Eight students met criten 
(5/^5) on the task.-. The thirdttsk (question 3) requ1re<J that the 



. < 100 



. • / . • ^ • • ^ _ . ^ 

•student complete a/statement which dbmposed the generalization for short 
/ , ' ■ , . . ■ . • . ' 

■^Kowel sounds in wprds. Three: of the eight students composed the gener- 

alization satisfactorily. ^ ' *; * ' 

> " • . ^ . ' 

Pretest 5 tested^preservice teachers' knowledge of syllabica-' 

" ' t • ■ • - ^ ■'' 

Ui-on. Twenty-four pf- 67 percent of the-learn^oS identified t^he process 

. • <' ^ ^ 

(^Mtion 1). Of the 24 learners who, identified the process I „20 met 

the cHterionif syllabicating ftve,* two-syllable wo/is! lire next 

f 

tasks, (questions 3 ani.4) required that the «tudentV complete state- 
ments of syllabi q principles 'that governed the, syllabi cation' of t^§ 
words. Neither of the 20 students met criterion on the last two tasks. 

Thirteen of, the learners met full criterion and w) on the. ' 
first task- in Pretest 6. Fifteen of the 18 students who nan»tf ^as- 
som^imes reRresenting a vowel sound were^able to identiVy; from among 
eight words, the six *fords /m wht5h ^ stood for ,a vowel sound (question 
2);*" eight stated jl^ of the In^t^ces in wh'ich ^ rep^fesented a vowel ^ 
sownd; one student sta'ted the tm6 Instances. None of the studer^s'were. 
aj&le t/» identifji each of the resultant vowel sounds recorded by ^ . - 
(questions 5, 6, and 7). \F1ve of the stj^nts naming ^also identified 
w as a consonantal etter vnfitch could represent a^vowel sound; one stu-' ' 
dent named only w. Neltberl of the six student^- identil^lng w could 
cite the Instance when w represented a vowel sound In words. 

The performante data from Pretest 7 rev^alerf that 30 on^^ 
percent of the studertts were familiar with the term "long vowtel soynd" 
and chose ^hls as the, label for the vowel sounds In. the woms presented. 
Twenty' of this 30 met criterion on the second ^task (question 2) by 
Identifying from five groups of four words, the wor^lfl wiilch the 
vowel sound was long, ai^d giving the name of the vowel letter whose > 



lo^g ^ur}\i was he^d. Ci^iterion for th|i>ta$k was'^sA: None o^,; 

who Identified th^ long vpwel sounUs^n ,the words was" abte to j^- 

plete the statements^ ^ general jzatiohs*}qi*estions 3^4, aod sAor the 

vowel sourjdS'in sets Of 'words presented on tl?e image.-. ThOl^aJ ques- / 

.t|^. was nofpresented to any o5f«^the studepts since iy(Q^-^{iggerjt'^- 

on tb? students havinjg'niet.criterion on question 5. /r 

Pretest 8 tested\the p^es^rvke teachers/icnowle'dg'e of vowe'l 

. letter combinations. Twenty^ iFbur or -67 percgyi correctly chose the » 

label diphthdng (question 1) fjr^th?* Mnderljned lorabi nations in the 

words presented. ^Only'll of the students, wija assigned the appropriate*: 

label selected t-he correct descriptor (question *«) of the diphthong. 

» > . . . , • * ■ \ 

Question three. |A'esented *«rds» in wljich the un<lerlined ywe] combina- ' 

tions' wire digraphls . J Fou'r^or 1 1' percent of th^ j)reservice teachers . 
jhoje tl\^ cjrrecfr lab^l; two of these f^r* selected the stat^nt t+iat 
^most accurately described a vowel digraph (quest,i6n 4). The two stu- 
dents who responded; correc.tly to the first four questions both me^ / 
ci'iterion on* the remaining t^sk' (question 5) of identifying combina- ' 
tjons as diphthong^ or^'digriphs. , ' o 

Pretest 9 measured tho' pr^service. teathers' knowledge of con- 
sonant irregularities. Thirty-four or 94 (percent of the students corr 
rectly r^ted the exampWsjSf letters not. represent fUg sounds in- certain 
cplnbinations as "si>ent letters" (question 1). Only these 34 learners 
were presented the questions dealing with eight specific instances of ' 
"silent letters." The findings follow: 19 students responded cor- 
rectly to h as a silent letter (question 2); ten students knew when w 
did not represent a sound in words; 19 students selected at least two 
Of the three instances in whicJj the combination ^h did not record 4 



»sqund in words (question^)-; fifteen name^^an;! k'as riotVeRKe-? 

^ . sentfn? sounds jjfhjBn followed by n irf the -same syllable ((^ueilipn 5)*; 

thjrty-four Students ' responded correct)^ to "silent tj' (question ,6) ; 

^\ffiyie students answered the question dealing with "sfl«nt p"' (question 

7) and ll\cite(i ihe, rule for "£ "before m" (question^S);- «d.-28 

' responded -correctly to question- 9 which dealt with "silent" b. ' ■ 

Questions 10 through. li. dealt nith the- soft c and g rule. - 

Thirty- three, or' 92 percent of the students sel.ected ];as the- letter 

representing theWt a sound; thirty-ine identified £ as the letter 

^-^reprej^ntin^ the soft c sound. Only thos^ learners con^tly answering 

/^v questions 10 and '11 ' received .question 12 which required the s^ectlon 

of the three letters whicK determine the soft sound of c .and £. Eight 

* stufcn^s -identiffed the three letters, e, *i, and yi 'six students noted . 

.'the position of these Tetters (question 13) When ttie^ control the sound 

. of c and £. Thirty students correctly' selected hJ. as the coifipanio/i to 

^ (question 14); and 23 chose the combination (^estion' 15) which 

represented the gu sound. The last two questions dealt with the sounds 

represented by s.. Twenty-eight students chose the* word in. which s_ 

represented its most common sound; twenty-five .named z as the fetter 

reptpsenting the sound of s fn his and runs. . » 

' >~ ' • . 

The last prefest. Pretest 10, measured knowledge of vowel 

, ' ' ~\ 

irregularities and ,is in five pants. The five questioos in part a deal 
^ with the ""j^chwa" sound. ° Nine students correctly selected the term 
schwa as the label for the vowel sound in the unstressed syllables in .. 
spoken words; of tlie nirte whp selected the correct label, four Selected 
the best descriptor (question 2) 6f the^ schwa and the situation in 
wMch the schwa occufs ^question 3). m Student correctly responded 



to the remaining two questions {4 and 5).* Part b"^of the prgtest * 
measured knowledge about the effect of'T on vowel sounds. Ten stu- 
dents selected r as the "vowel control lecM^^ti^l on 1); seven selected 
the appropriate descriptor of . an ir-controlle? voJ^J Sound (ques'tfon 2)/- 
Three students noted the position of r when^t control led the vowel 



sour^. 



I 



' l^-^ ^ Pmest 'ld coijtained two^queStiofis about the:pffect 

of 1_, w, y, and 11 onW *sou(|d re^esented by t/ie'jetter a. Five ' 

students chosp the spflling represent ing^Jw nesiiltant vowel sound\' 

. ■ ) r . c . • * . ; . 

Part d of tt»e pretesf .contained one question- about' the sou nils* re'pre- 

sented by t[je co!i*fnrfth*on 'oh;* Four* sISjdents met criterion on this 

question. Thei^last section/lO e, contained four questions about the 

effect of Id. 0" 0 and^ the effect of Id, flh, and nd on i_; Sixteen stu- 

dents pointed qut thf word in which the vowel sound ^was an exception to 

^ • • * • * 

the generalization frfr short vowel sounds (questiort 1); none stated 
thi^gerieralVation covering the «xceptiqpv (-question 2). Twenty-nine 
students correctly responded to the third question by selecting the 
word iri which the vowel sound conformed. to generalizations for vowel 
sounds from a set of exceptions. Neither of the 29 students stated the 
/ generalization covering the vowel sounS .tn the repiaining words. 



Pretest performance by individual students . Pretest perfofrtiance 
■'by individual student is reported in Table 2. The total pretest con- 
tained 116 questions^ Twenty-six of the students, were asked at least 
half of the pretest questions; five students were asked at least two- 
thirds (78) of the questions. The highest number of questions presented 
to any* student was 91, with the lowest nuij*er being 36. It should be 
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noted hene that i^very student'was prresented the fairvimum number of iJre-r 
test questions (i.e., the first in every Werarchy) which totaled 17'. 
The number of^orr^ect responses per student ranged from a high of 60 to 
a low of 15. The number of, correct responses, .when co/vertsd ^o tota j^ 
y ' points (points pervfeature) and weighted in^ferms of percent of total 
. points possible, showed a hijjj of 25.5 percW" attaioment with a Idw 
\ 6.5 per^t. As. seen in Jable 3 below, the mean percent of pretest 
attainment was 16. fl; the standard deviation was "5,9 and the /ange was 



■ f 
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* Table 3 



Pretest Summary Data. 



V- 



Mean Cftrrect 
Responses 
. A 



Medn> Weighted 
Sep re • 



t 



16.0 



Range of 
Scores 



, Standard Devi^itlon 
' (Weighted Score) 

7" 



e.s-^s.'s ^ y ' 5.9 

^•'(19.0) ^ . \ ' 

— '-i^ — 



■J 



. ) in. terms of cfbck hours reqQired. to c.orjiete the pretest, the 
mean time was 5.4 minutes with. aStandard deviation of 18 minates. - The- 
. range of pretest corapleti'on^ime-was from 30 minutes to .one hour and 
36 minutes. ' v , • ' ' , , 
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Findings Related to ^ 
Incourse Pe rformance' 

v « 

t • 

Incourse performance data were collected in order to report 
findings from the operational use of the program in terms of instriic-, 
tional strategies, mastery of concepts'^during instruction and instruc- 
tional "time. These data wef^e sorted and collated from the course '.^ 
master tape and are reported oh Form'c in' Appendix H. 

Segment containing EP * ' 

EP Idervtifier (enter .and process is the point within the pro- ' 
gram that the computer "waits" for a response from the.studentO 
Number:/ of students presented EP" 
Number of studtfnts correctly responding on first try 
Number of students responding incorrectly on last try- 
' Difficulty level i Percent of students correctly responding to 



Meaii number of responses to an EP - ^ 

* Number of students .whose response latency exceeded one minute 

' , • ' ■ 
•for an EP ' • . 

$ 

s , \ 

Response mode (light pen, keyboard) 

The above data were reported only for the mastery items in the ■ 
course. Every Item represented by an EP 1<isnt1fier was not considered 
a major Irtstructlonal Item. The majority of the enter and process 
point tasks *vere concept builders and practice Items. After the stu- 
dents had responded to the cueing and practice materials, the mastery 
task was presented to determine If and to what extent the student had 



\ 
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conditioned to the cues and^nefited from the practice. The means, 
standard deviations and ranges of instructional times are 'reported by 
^ segments and for the total course in Table 4. 

\, ■ The difficulty level of an item indicates the percent of stu- 

dents who attained mastery of the concept tested By the item. The 
difficulty level, may also be reported as the inverse of -those dejnon- 
. strating mastery and be stated in* terms of the percent of students for 
whom the item appeared too difficult for them to deqionstrate mastery. 

If an item w.as difficult to the extent that fewer than 80 percent of 

.. ■ ' / ' 

the learners-after instruction-demonstrated mastery, that item was 

' •■ . . 

d^gnated for analysis, review and revision. The analysis woujld 

include reviewing the related. cubing* and practice materials, the 

instructional strategies incorporated, the response modes, and the' 

mastery item itself in an effprt to (^ptermine to what factors the 

difficulty might be attributed. ' ' ' ' 

Segment I: 'phonics readiness, definition of phonics/ sugges- ' 
tions for beginning instruction . In Segment I, 15 mastery ~tasks were 
achieved by at least 80 percent of the learner* presented the task; a 
minimum of 80 percent o^pie learners did not demonstrate mastery. on 
seven of tlie tasks. Of the seven tasks (noted by *) for whicTi the 
recorded difficulty levels were below 80 percent, three were be,iOW 4^ 
percent; three were between 72 and. 74 percent, apcf one had a recordid 

• • • 

difficulty level of 56. • 

The mean number of responses for 16 of the 22 items reported 
/was one (10. f^ur Mtems required a mean of two (2) responses and two 

>s * ^ 

' tasks required a mean of three (3) responses. Response latencies 



Table 4 

Mean, Standard Deviation and Range of Instructional Time 
by Segment and Total Course 



Instructional 
Segment 


Instructional 
Time 


Standard 
Deviation 


Range 


Phoni I 


1 hr. 48 min. 


24 min. 


1 to 3 hrs. 


Phoni II 


1 hr.^ 6 min. 


12 min. 


36 imln. to 1 hr. 
. 4l8 min. 


PhonTlII 


1 hr. 


12 min. 


36 min. to 1 hr. 
36 min. 


Phoni IV 


1 hr. 48 min. 


- 20 min. 


1 hr. 12 min. to 
^ hrs. 


phoni V 


1 hr. 


l2TT)1n. 


42 min, to 1 hr. 
36 min. 


Phoni VI 


18 min. 


12 min. 


6 min. to 48 min. 


Phoni VII 


42 min. 


12 min. 


•24 min. to 1 hr. 
12 min. 


All Segments 
(Including 
Pretest) Time 


8 hrs. 42 m1n. 


1 hr. 30 min. 


• • 

6 hrs. 30 min. to 
14 hrs. 



m 

greater than one minute were varied for the tasks but were found to ,be 
predominantly in the keyboard constructed or keyboard multi -lined ^ 
response modes. A conspicuous trend relative to /response mode, 
response latencies greater than one minute, difficulty level (or number 
of students demonstrating mastery) and number of correct first 
responses was diptected. With the exception of EP aa46a 7, no question 
requiring a light pen response recor^ded. latencies greater than orte 
minute. AIJ difficulty levels below 50 percent were from the tasks 
^"requirir^ niulti -lined constructed responses, with one exception. 

The mean number of hours>»required to cooiplete Segment I was 
one (1) hour, 48 minutes. Student completion time ranged from one to 
three hours with ^ standard deviation jjf 24 minutes,. 

Segment II; consonant blends, instructional, procedures and 
• principles . It should be noted here that several .responses were 'sub- 
jected to two evaluations, Th^ ffrst evaluations cii;ed (ca37a a3, 
ca38a. a3, ca39a a3, ca40a a3 and\ca42a a3) were made by the author/ 
instructor. The .corresponding evaluations (ca37a b7, ca38a b7p 
ca39a Ij7i ca40a b7 and ca42a b7) were student self-evaluations. The . 

4. 

author/instructor evaluations were used for computing the difficulty 
leve.ls that'are::discussed in the next cKapter. 

Some of the trends. observed in the findings from Segment I were 
also evident in Segment II. The five mastery tasks not correctly 
responded toby at least 80 percent of the students. were found to be in 
the multi-lined keyboard response mode. There were 25 tasks in all. 

There were several light pen "responsis for which at least one ' 
student took longer than one minute to respond. It was determined that 



many of these light' pen responses were related to multi -lined keyboard 
' responses and to image "models" which students had to read before they 
could evaluate th^r responses and then^enter that evaluation. 

^ Each of the" keyboard muT'ti-l'ined r6spon*ses had at least one stu 
dent -whose response latency exceeded one minute. 

It was found with the first set of student-evaluated responses 
that the student and' the author fully agreed pn bnly one evaluation. 
One evaluation differed by three responses (29 versus 32); another by 
nine (21 versus 30) and another by 12 (11 -versus 23), The mean ^ 
difference was eight. ' 

The inean time for completion of Segment (jl was one hour and 
six minutes. The range of student time was from 36 minutes to one 
hour, 48 minutes with a standard deviation of 12 minutes. ^ 

Segment III; consonant digraphs and procedural steps . Six or 
27 percent of the 22 4nastery task items did, not conform to the .desired 
difficulty level in j^egnifnt IIIv Of the six items, three had a diffi- 
. culty level of 78; one was at 64. One item recorded a 44 percent 
difficulty level with the lowest difficulty level being 28. The mean, 
number of responses to each item'*«s one (1)'; and 12 tasks had at least 
one student with response -"latencies greater than one minute. An 
interesting fact was noted: eighteen of the students took more than 
one minute to respond in the light pen mode to the task identified by 
cfl9a b7. I ' \ " 

There were seven instances where .students .typed "multi -Tirted 
responses and evaluated themselves. The author/ instructor and student 
self-evaluations compared more favorably iri this segment than in 
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Segment II. Complete agreement was found on the four evaluations 
identified by cf63a a3, cf63a b7; cf65a aS; cf65a t7; cf66a a3, 
cf66a b7; cf67a a3, cf67a b7. "Wie differences on the remalnin'g three 
evaluations were four (cfl9a a3, cfl9a b7), six (cf64a 33, cf64a b7) 
•and two (cf68a a3, cf68a b7). 'The mean of the differences was four. ' 



The mean instructional time for Phoni III was one(T) hour. 
The range of instructional time was from 36 minutes to one hour and 




36 minutes, with a standiard deviation of 12 minutes. 

Segment IV; generalizations for vowel sounds and principles of 
syllabj cation . Segment IV contained 70 major tasks. At least 80 per- 
cent ^ the learners presented the task demonstrated mastery on 43 of ' 
the tasks. Five tasks had difficulty indices below 80 but above the 70 
percent level; twenty tasks were it or above the 50 percent difficulty 
level. One task had a 42 percent difficulty level and one task had a 
difficulty level of zero. The mean number of responses to most of the 
items was one (1) with.no i^em. having a response mean greater than 
two (2), . 

Fourteen of the items having a difficulty index less than 80- 
percent were. in the keyboard multi-lined, keyboard fill-in, or keyboaj^ 
multiple choice response mode. Thirteen items were in the light pen ' 
response mode. 

.The largest number of students with response latencies greater 
than one was found for those tasks in which the light pen responses 
were related to self-evaluation (val9a b7, va27a b7, ve09a b7) or to . 
multi-lined or constructed keyboard f1lT-in responses (vgl7a' 3, 



■>■ ■ . .•' ■ ' ■ 

* ' 

vg23a •3,,- vg27a al, vg28a al, vel3a k, veUdT blr). At, least one stu- 
dent, but no more than two, had response latencies exceeding on< linute 
on 25 additionat tasks. - • ■ ' 

Student self-evciluations (vap9a 7, val9«f b7, va27a b7) were 
fairly consistent with author/ instructor evaluations. 

^Segment IV required a mean instructional time of one (1) hour 40 

« 

minutes. Student tifne ranged from one hour and 12 minutes to three- 
hours. The standard deviation of instructional time for Segment IV 
was 20 minutes. 

# * 

Segment V; vowel' combinations . There were 28 major tasks in 
Segment V. More than 90 percent of the learnerr. demonstrated mastery 
on 23 of the 28 tasks. Two tasks were below the 80 percent difficdlty 
level but above the 70 percent level; three recorded indices below the 
50 percent difficulty level. 

Three of the items not having satisfactory difficulty levels 
were of the keyboard fill-in response mode; the remain^ing three were 
in the light pen mode. 

Most tasks recorded response means of one (1); four recorded 
means of two (2) and two tasks had a response mean of four (4). The 
number of response latencies greater than one mihute was greatest for - 
the keyboard fill-in type responses; one light pen response, however, 
recorded 11 students with response latencies greater than one minute. 

This segment required a mean instructional time of one (1) 
hour. The range of instructional times was 42 minutes to one hour and 
3? minutes. The standard deviation was 12 minutss. 
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' Se^ntent VI; consonant irregularities . Segment VI contained 
.22 mastery tasks—each of .which recorded difficulty levels greater than 
80 percent. More specifically, 20 of the items had difficulty levels 
of 100; two h^d difficulty levels of 88 and 89 respectively. The mean 
number of responses to all but three of the tasks was one (1) and 
response latencies greater than one minute were recorded for eight 
tasks. Item ecl8a 1 recorded eight students with response latencies 
greater than one minute; seven items recorded either one or two students 
whose response latencies were greater than one minute. 

The mean instructional time for this segment was 18 minutes. 
The standard deviation wls 12 minutes with a range of 6 to 48 minutes. 

Segment VII: -vowel Irregularities. Segment VII contained 25 
mastery items. Twenty-one of these items recorded difficulty levels 
above 80 percent; four did not. The items recording the lowest diffi- 
culty level were of the keyboard fill-in response mode (vm06a bl) and 
the keyboard multi -lined response mode '(vj08a 3). 

The mean number of responses to all but one of the tasks was 
one (1); the exception .(vj06a al) required a mean number of two (2) 
responses. 

Five of the items to which at least one student recorded 
/esponse latencies greater than one minute were in the keyboard fill-in 
response mode; two were in the keyboard multi -lined response mode. 

This segment recorded a mean instructional time of 42 minutes 
and a standard deviation of 12 minutes. Inst^ructional time .ranged from 
24 minutes to-one (1) hour and 12 minutes. 



Findings Related to 
Posttest Performance 

The ^'incjings from posttest performance data are reported in 
this section in order to answer the question of whether the course met 
the preestablished criterion level 'i^or validation (80/80). The 
findings were also used to determine which posttest criterion items did 
not meet the 80 percent criterion\level. In addition, individual stu- 
dent pre and posttest performance was Jtsted to show learning gains 
which could be attributed to the computer-assisted instriiction Phonics 
Program. * ' , 

Course validation findings . Performance of the validation 
group on the posttest is shown in Table 5. Inspection- of the datr in 
Table 5 revealed that 83 percent of the grout) attained between 80 and ^9 
percent of the terminal criterion, objectives. All of thd students 
attained a minimunvof 30 percent of the objectives; but no studfent met*' 
100 percent of the criterion objectives. 

Criterion test items findings . The criterion test (posttest) 
concisted of 26 items. It had been indicated in the Validation Plan 
that each of the criterion test items should be met by a minimum of 80 
percent of the students. If a test item did not meet the criterion 
level, that item would be starred (*) for reassessment. The findings, 
presented in Table 6, sbowed^that 80 percent of the students met crite- 
rion on eight or 31 percent of the criterion test items. Since one 
.question could measure the attainment of one or more of the objectives, 
an "objective-oriented analysis" revealed that the following objectives 
were fully met by at least 8a percent o/ the students: 



( . 



Table 5, 
Materials Validation Data 



Percent* of 

Terminal „ Percent of Validation Broup 

Objectives Attaining Objectives 

100 • 0 

90-99 . ^ . 31*> 

*80-89 •? '^*83 

70-79 86 - * 

60*69 ' 94 . r * 

50-59. , *. . ' ^94 

. 40-49 j ■ 97 

30-39 100 

20-29 ^ • 100 ' • 

10-19 100 



*80/80 Criterion Level 



\ 

\ 



J Table 6 / 
Criteridn Test Item Analysis Date! 
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Posttest Qudbtion 


[)bjective(s) 
Measured* 

r i 


Number of Students - 
Meeting Criterion 


r ^ 1 wd 1 w 


1 




• 1. 2 


. 2^ 


61 


2 


* 


31 

« 


20 


55" , 


3 




.3. 4 


23 


64 


4 




5/6 


. 11 


31 


5 


• 


7 


32 


. 89 


< 6 


f 


9 


24 , 


6'7' . 


7 




8 


31 


86 . 


- 8 




10, 11 


5 


14 - 


9 




^12 


33 


92. 


10 




13 ' 


' 18 


50 


^ 11 




14 


• '24 


67 


12 




15, 16 


13 


36 , 


13 


* 


18 . , 


28 • 


78 




17 


32 


89 


♦ • 15 




19 


' 32 ' ^ 


8$ 


16 




21 


18 


50 


17 . 




20 


21 


♦58 


- . 18 V 


»• 


23 


32 


89 


; ' 19 ' 


0 

V , 


22 " 


30 


■ 83 


• 20. 


■# 


25 


K) 


44 


21 




• " V 


8 


22 


• ^ 22 




^ . 24 \ 


25 




; ?3 






25 


69 


24 




28, 29.. * 


28 : • 


78 


. 25 ^ 


a 


32 


24- • 


67 


26 " 




30 


26 


'11 



* 1 .9 

> ■< %)J - . * 

, ■ \- 

Objectiv^i: The learner wiU name the four prerequisites for 

phonics instruction. ' ' «• 

Objective 3: The learner will identify the distinguishing, 
' quality of a iibrisonant blend. 
v» Objective 5:- The learner will describe the distinguishing 

quality of a consonant digraph. 

Objective 7? .The learner will write one key word for each 
short vowel sound. 

. Objective's: The learner will correctly syllabicate twp words 
and give the syllabication rule for each word. 

Objective 12: The learner wilT write aVaije-s^Jjfble key word 
^ for the long sound of each vowel'. ^' 

Objective 17: The learner will describe the distinguishing 
quality of a vowel diphthong. 

Otuective 19: The learner will name the four coimon diphthongs'" 
alrid write a key word illustrating the diphthong sound of each 
- combination. * 

* t' 

. Objective -22: The learner will write one word in which^s 
stands for its most common sound. 

# 

bbjective 23: The learner will name the vowel letter that 
•accompanies £ in order fot* £ to be sounded in a woj5. . ^ 

Indi vidual pos ttest 'performance data . The posttest performance 
Of individual students is; reported in Table"7. %his fable also provides 
a recapitaiatfon of Individual student pretest performance. ' 

"The findings show gains by^ipo percent" of the learners. The 
minimum' .-gain, in percents, was 23.5 percent (Student ID - PCO0); the 



^ Table V* 
^Summary Perforindnce Data 
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StucfeYit ID * Percent 
Number • \^ ^ Pretest 


PAM 


7.. 6 


PBH0 


- 14^6-- 


PBK 


ie.3 


• PBT 


18.4 ■ 


PBW 


17.9 


PCA- 


. 19.5 


PCK 


-10.3 


pcb 


' . ' ' 16.8 


PCO0 


6.5 


PCS 


1/9-. 2 


PCV . 


17.4 


PDB 


14.6 


^ PDC 


" 11.4 


PDD 


15.8 


PDF 


13.5 


PDK 


10.3 


• PDK0' 


31.0 


• PGH 


21.2 , 


PJG- 


24.^5 ' 


PJM . 


1"9.0 


PKS 


11.9 


Plj 


, ■ ' 10.8 


PMB ' 


• 25.0 


PMB0 


11. 9* 


PMC 


13.0 


PNH 


• . 13.6 



Percent 
Posttest 

65 
88 
72 
83 

• 

*79.8 

82 

90 

83 

30 
. 65 

84 
• 86 
^ 83 

85* 

•87 ' 
88 
89 

84 . . 
82 
90 
^2 

90 / 
96' 



» > 



CJmulati-ve 
-Instructional 
Time On'-Line 



r 



8 hrs. 45 

9 brs<^30 
9 brs. 36 

^ 7 hrs . 
i hrs. 
I2vhrs. 30 

7 hrs. 6 
"8 hrs. 30 

8 hrs, 30 
7 hrs. 36 

9 hrs. 54 
7 jhrs. 24 
6" hrs. 

7 hrs. 12 

6 hrs. 48- 
•7 hrs. 6 
'8 hrs. 48 

"7 hrs. 48 

5 hrs. 54 

8 hrs. 24 
9, hrs. 18 

7 hi*s. 6 

7 hn. 12 

6 hr^VNlg^ 

8 hr^. 54 
; 7 hrs. 48, 



mm. 
min. 
min. 



min. 
min. 
min.^ 
min. 
mi n 
min. 
mi n . " 

min. 
•min. 
mi ri . 
min. 
min. 
min. 
min. 
min. 
min. 
mi n . 
min. 
min, 
min. 



These 
r^eporting ,them 



scores were rourraed to the nearest 
for course validat1o;i./ 



w()ole number in 
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Table 7 (Continued) 



Student ID 
Number 



PMO 
PNM 
PNN 
PPH 
PPM 
PPR 
PPS 
PPY 
PSC 
PSN» 



Percent 
Pretest 



10.9 
15.8 
19.0 
11.9 

7.1 
8.7 
25.5 
"17,9 
17.9 



} 



Percent 
Postt^st 



47. 

97 

83 

92 

91 

64 

83 

93 

93- 

89- 



• Cumulative 
Instructional 
Time On -Line 



6 hrs, 
6 hrs, 
e^l^rs, 

6 hrs, 

7 hrs, 
7 hrs, 
7 hrs, 

5 hrs, 

6 hrs, 

7 hrs. 



18 min, 
18 min. 
24 min, 
54. min. 
36 min. 
36 min. 
36 mio; 
30 min.. 
54 min. 
54 min. 



maxfmum gei^n was 82 percent (Student ID - PDF). Th^ mean of on-line 
-time eight hours, 42 minutes with a range from six hours, 30 ntinuta 
to 14 hours. The standarti .deviation of on-line time was one (l)*hour, 
30 minutes. ' ' 

S 

Po/tcourse ccmments by students . After the course was com- 
pleted and students had taken the posttest, general comments on the 
course were informally recorded. These comments were voluntary and 
were not limited to any prescribed question or to any particular areas. 

The comments on the course are given in Appendix I by student 
number. All of the students who tommented indicattJ that they felt 
they had learned phonics. Most of the students showed favorable 
attitudes toward computer-assisted instruction but expressed some 
frustratfon toward the malfunctionings of the system. Students 
appeared to like the ideas of self-pacing, self-Competition, and self- 
evaluation. The repetition of concepts was viewed favorably by some ' 
students and as "overteaehing" by others. The length of the posttest 
j««s-^vTSwef as excessive by several of the students. 

Operations Analysis Findings 

The operations analysis, while performed independently of the 
validation run, has direct implications for the validation study. 
Although well-designed and maximally coordinated operations do not nec- 
essarily result in .a smooth-running, qual ity^rogram, it H axiomatic 
that a smooth-running course is partly the result of well -coordinated 
and well -tested operations^ 

The o'perations included in the analysis are these technical 
functions: programming. Image and CRT graphics production, audio 
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recording and production, technical support management,' and systems 
analysis and operations. The operations analysis data were secured by 
having course operations personnel fill out short, open-ended ques- 
tionnaires. The completed questionnaires are \ Appendix J. The 

■ 

findings are summarized below. ^ \ 

• I 

Prograimiing . The programming operations for the Phon.ics Pro- 
gram appeared fundamentally satisfactory. However, two "malpractices^ 
that occurred during the development of the course and ^bai' possibly " 
resulted in errors during the operation of the course were ctted by the 
^programmer. These practices included: a) changes in audio script 
which were made at tie time of recording without the prograimier being 
notified, and b) some "last minute" author revlsioi^s before the valida- 
tion run^which did not allow for adequate testing before use. 

Technical support . The major difficulty encountered by the 
technical support manager Was that of securing the image reels in time 
for testing with the course before the validation use. No reason>was 

ft 

given for the difficulty, but it was implied that adequate notice had 

♦ 

not been given to coordinate the productdbn of the image reels. 

Audio production . No compi icatidns were noted irv> the audio 
operations of the program. 

m 

Course development . Aside from the common difficulties experi- 
enced during /the development and. operations of a computer-assisted 
instruction program, the course developer and coordinator noted a com- 
plication which affected both the development, testing and operation oT 
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the Phonics Program. There were inadequate funds with which to direct 
the project. Because of this lack of funding, "cutbacks" were nec- 
essary 1n programming and other production areas. 

. Dtfring the operational run of the protiram, a major systems 

- 

breakdown occurred which resulted in rescheduling and a decrease of 
terminal usage for the students. ' 

In addition, during the operational run of the program, several 
problems arose that were' due to minor programming "bug* " When the 
programmer or systems analyst was unavailable, countless minutes were 
wasted because the author/proctor did not have recourse to "moving" 
the student on through the]^ course. 

Image antf CRT graphics production . The CAI artist, who devel- 
oped and tested the CRT graphics and drew the final proofs from which 
the image reels were photographed, listed difficulties brought on by an 
initial lack of communication between the author and artist, and by 
last minute corrections. It was recommended that. there be preplanning 
between author and ap;irist and that a production schedule be estab- 
lished and closely followed. It was also recommended that the image- 
reels be reshot in order to obtain sharper images. 

Systems operations and analysis . The report from the systems 
analyst revealed that systems work related, to ttie Phonics Program 
entailed no igajor adjustments. It was noted however, that the need for 
systems manipulation for operational debugging implied some program- 
ming errors whi^ch could have been avoided by additional testing. The 




■ ' 125 



oie area i^n which the analyst acknowledged a need for change was 1n, 
records processing,. It was suggest/d that a time schedule for* requests 
be set up and that onTy data which af^e to be used be requested. 

Summary of Findings \ . ' 

T|ie findings from the data analysis reported in each section 
are summarized and enumerated below: • ' , 

/ 1,^ Preservicel teJ^chers without phonics instrwction ar*e famil- 

c 

lar with the headings under which specific phonic elements are classi- 
fied (i.e., consonant blend, long vowel). They do not however, know 
the qualities of the phonic elements jand the generalizations goyerning 
sounds in words. Students were especially unfamiliar with generaliza- 
tions for vowel sounds, vowel- irregolari ties and phonic readiness 
components. 

' 2. The use of the , contingency hierarchy and the branching in 
i;he pretest ,can£eTled at least one-third of the pretest questions for 
learners who did not demonstrate knowledge of the concepts leading to 
the cancelled question. 

3. On a percent-score basis for the total pretest, the mean 
percent attainment was 16 percent. Without instruction, the learners 
(as a group) demonstrated competenc/ on 16 percent of'the test items 
measuring the terminal objectives. 

4. Of tjie .^14 mastery items in the course, IfO or 75 percent 
recorded difficulty levels of 80 percent or higher. More specifically, 
15 of the 22 incoUrse mastery tasks were at the desired difficulty 

> 

level iR, Segment I. Twenty, of the 25 mastery t&sks presented in Seg- 
ment II were at the 80 percent difficulty level. Sixteen of 22 



incourse mastery items were at the desired difficulty level in Segment 
III. Segment I,V recorded satisfactory difficulty levels for 61 percent' 
of its. 70 mastery taskS, while Segment V recorded learrter mastery of, 
23 of the 28 tasks. ' Each of the mastery tasks in Segment VI had diffi- 
culty levels above 85 percent; and 84 percent of the 25 mastery items in 
Segment VII recorded difficulty levels above 80 percent. 

5.' Eighty-three percent of the group attained scores between 
80 and 89 percent on the criterion posttest. ^The validation criterion • 
level, wis 80/80.'" ' 

^ 6. Eight of the criterion" test items met the 80 l^^rcant 
criterion level and the following objectives measu^d by tl^e test ^ 

items we^ fully jnst by at least 80 percent of the students: Objec- 

' i 

tives 1,13, 5, 7, 8, 11, 17, 19, 22 and 23. 'Since the crite'/ion test 

\ \^ ^ 

score was^ based on points assigned per feature, it should be noted 

that some students noted five of .six features, or three of four fea- 

tures on some iteins. While such situation's did not render the student 

t 

as "fully" meeting the objective, ^it seems justifiable to point out 
that criterion on each of the test items was partially achieved by 80 
percent of the students. 

7. Every studen^ showed gains from pre to posttest perform- 
ance. The gains were empirically significant and ranged from 23.5 per- 
cent to 82 percent. * 

8. Voluntary student comments revealed a general satisfaction 
with the poyrse. Complaints were registered for the posttest (too 
long, too vague at some po1n,ts), for machine dysfunctions, and unneces- 
sary repetition of some features. 
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• 9, Actual on-line time revealed WTae dispersions between pre- 
test time required, instructional time required for each segment and 
cumulative time on-line, 

10, Most of the operations relative to the Phonics^ Program' were 
deemed well -coordinated. Some difficulties were encountered because of 
*last minute changes (programming, art work), insufficient prepU nng 
ami personnel coordination, and by the deadlines imposed in the ^ 
recorcjs requests. The course wa| viewed by working personnel as an 
effective use of computer capabilities,^ 
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CHAPTER V 
CONCLUSIONS AND RECOMMENDATIONS 

Conclusions Based on 
Pretest Performance 

The linalysis of the findings from the pretest data led'to the 

conclusions about the feasibility of pretests for branching student| to 

^instruction and about the status of the preservtce teachers' pbonics 

knowledge .without individualized instruction. Recommendations for 

future use of the branching strategy and for upgrading preservice 

teacher knowledge based on the conclusions were listed. 

Feasibility of branching based on pretest performance . The use 
of the "contingency hierarchy" appeared to have been a feature which 
sa^ed both time and anxiety for learners who were only slightly or not 
at all familiar with the concepts; only five students were presented 
more than 75 percent of the questions. The Deory that branching is 
economical was substantiated by the smaller number of instructional 
hours needed by students with the greatest number of correct pretest 
responses. The one student (ID Number - PCA) who did not fit the pat- 
tern was an ardent "note taker" who was observed spending an unusually 
large portion of her time copying information from the CRT or the image 
screen. ' 

Confirinirtion'of the fylbility of branching ba.-^d on pretest 
performance was also found in posttest performance. Students who met 

» 

criterion on concepts measured by the pretest items also met criterion 

« 
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fin these same .concepts on the posttest. Of the students who were 
branched. ov^r any instructional section, all met criterion on t-hose 
concepts on the posttest. These findings implied frhat the use of thi^ 
pretest' was a wise and justifiable strategy. The review options given 
to students who met cr.iterton and were branched over instructional 
materials allowed for closure of the information and made the branching 
strategy acceptable. 

. Problems of branching based on prfftest performance . Several 
problems surfaced during the operational run of the program. One pVob- 
lem w4s in the construction of the pretest items and in the programmed 
"correct" responses. It was likely that some students were penalized 
because of a correct but unanticipated in4 consequently unaccownodated 
response set. In addi':ion, some answers were so stringently program- 
med for that'misspelled words or sj^itactic deviances were recorded as 
incorrect. 

The duplication of student performance, which resulted from 
students being "taken back" through a pretest question because of some 
technical difficulty posed still another problem. The elimination of • 
such duplication from the records required a manual sorting of the' data, 
which was a laborious and time-consuming process. ^ ^ 

Since the. pretest was often the first experience at the com- 
puter terminal for many students, some problems encountered. during the 
pretest may have been a direct result of a student's lack of sophisti- 
cation with the system. 

Some programming "bugs" were rjpt detected until the actual run 
of the pretests with the validation group. These "bugs" were rt^moved 
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as. promptly as possible; but some students were penalized because of 
the(n. For example, one part of an audio message was muffled and . 
students had to respond to what they "thought" they heard, Conse- , 
quently, several responses to the question a^out the audio message 
were incorrect. *^ '. » - • 

Two'-students shed -light oti.the "guessiflg" factor inherent in 
any testing situation/^ These students stated that they had guessed on ' 

* some questions ancf were branched over information which,' in fact, they 
did not know.. The built-ih review options could have served as the 
precautionary measures against leaving the course without getting the 
ihformation. Too, the contingency hierarchy, which required completion 
of the highest item in a particular sequence in order to forego < 

•Instruction, was designed as a safeguard against guessing. Some stu- 
dents may have guessed because thfere was no answer alternative /for lack 
of knowledge, ■ * 

Usually all course segments >«re available for student ihstruc- 

* # 

tion. However, because of systems breakdowns, sometimes only selected , 
segments could be made available in that prior committment for disc 
drives had been ■made'*. If a student was scheduled for instruction and 
.his segment was not available,' the student had to be sMpped out of 'his 
preestablished instructional sequence based on his pretest performance 
and placed into the available segment. -In order to place students in' 
these instances, complex programming adjustments had/{o Be majie. 
■< Although not of the problem type, another factor of note war- 

rants mention. The course is so designed that it will not execute for 
demonstrations or reviewing without a pretest record. Consequently, 
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if a person wanted to preview the course, he would first have to take 
the pretest so that he could\i)e branched into the appropriate sections. 

Pretest performance as Tfidications of preservice teachers' 
phonics knowledge . Pretest data revealed that the phonics knowledge 
of preservice teachers, w<-hout insVuction, was far from 'substantial . 
The conclusions, drawn in the literaturt ^bout the status of preservice 
teachers' phonics knowledge and the inadequacy of most reading methods 
courses to provide the intensive instruction warranted by the scope of 
phonics content, were supported by both the pretest results and by the 
amount of Instructional, time afforded the individual student. 

The conclusions and Implications related to preservice 
teachers' knowledge in general areas of phonics content are presented 
below. 

Phonics readiness . More than 70 percent of the preservice 
teachers were unfamiliar with the readiness factors which are' Important 
to a child's success in phonic analysis. Without an awareness of these 
readiness factors and how they relate to phonics learning, many 
teachers will make little preparation for providing the necessary 
instruction -In the readiness areas. A likely consequence will be that 
many children will be thwarted In thelr attemptr t^ learn phonic 
analysis because they will ,not have been trained In the prerequisite 
skills. 

Consonant letter combinations . Since only 20 percent of the 
students knew the distinguishing quality of consonant blends and only 
eight percent demonstrated know1%dge of the sounding attribute of 
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consonant digraphs, it may be^concluded th&t .without intensive training 
in phonics, teacher knowledge in this area will be miriimal. Such 

minimal knowledge implied that efficiency in teaching children th^ 

^ *. ^ ' ' - - 

lettjer-sound relationships in the consonant' letter combination .area ,/ 

will also be minima/. Teachers, once on the job, will not be fully 

( . • ^ 

effective .in teaching their* learners the differences in the sound. 

qualities of these combinations. 

Generalizations governing vowel sounds in words and related 
syllabic principles . The findings in this area led to the conclusion 
that without instruction, preservlce teachers will go into the.class- 
Vooms very limited iir.their ability to teach children the generaliza- 
tions governing vowel sounds in words. Most of the teacffers will be 
familiar with ^ as a vowel but will be unabje to communicate the rules* 
governing the sounds represents . 

Vowel -letter combinations— digraphs and diphthongs— comprisech 
another area 1n which preserv1<:e teachers possessed inadequate 'knowl- 
edge. Without more intensive training provl^led by methods courses, 
these teat^hers will |iave -to resort to "telling" learners words instead*^ 
of teaching principles by which learners rjlght themselves' unlpck new 
words. 



; Consonant and vowel irregularities . Preservlce teachers 
appeared to be more knowledgeable about consonant irregularities than 
wi'th any other phonics content. It was concluded, however, that they 
would have to develop skill in accurately communicating the principles 
to children. Vowel irregularities would pose a greater difficulty for 
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teachers. Without training, most of these teachers would at best, only 
\ be familiar with "terms;" they would not vknow 1;b what the terms 
referred qr how to eff^tjvely ^cbwjnunlcate this contPnt to children. 

Scope and sequence for presentation . Since the preservice* 
teachers were so unfamiliar with, the content, it was logically deduced 
,that they could not order if in an acMptable hierarchy for presenta- 
tion. While it is, true that both the order and the explanation of the * 
phonics pMnciples to be taught aise provided lo the' most widely used 
basal readers, it is likely that teachers will only parrot the content 
of the readers and not really teach phonic analysis to thilft children, 
rn addition, when children are reading without basal readers, and 
encounter phonetically regular words, the teachers must know thk princi- 
ples governing the sound or they will resort to telling^the child the 
word. The same is .true if a group language-experience story or ot;her 
reading activity is planned. Teachers will not be able to consult 
their notes or texts in every situation and will consequently ignore • * 
several opportunities for teaching or reinforcing letter-$jund' rela- 
tionships in meaningful situations. 

Another implication from teachers' limited knowledge with the 
scope, and sequence of the content was that they will teach a class 
rather than meet individual student needs. Some of the learnerS in a 
classroom will need phonics readiness training; others will be.sophis- 
ticated enough for syllabic principles and accent rules. If 1?he ^ 
teachers are dependent on the teacher' ^guide,' they will only succeed 
in helping those learners whose needs happen to coincide ^with.t^e 

' r 



information presented in^e teacher's manual 
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Pnihciples arul procedural steps . It was concluded that because 
*- SO little about phonics content and principles was known, that pVe^erv- 
1ce teachers did not have, and would not have without instruction, a 
^ ' -.flexible format that could b,^ used to introduce almost any letter- 

?ound relationship^ Such a format, at the teachers* fingertips, would 
provide the teachers with a structured approach that would insure that 
^ ^ the objectives for introducing lettei^-sound relationships would be 
met. 

^- The principles for teaching letter-sound relSUon ships would ^ 

be another area in which preservice teachers would* be limited without 
instruction; Without an understanding of the principles for Intro- ^ 
ducirig letter-sound relationships, many of these teachers would make 
errorsMn teacMhg^thai mjght be harmful to some children. For 
example, if a teacher was not aware of the principle of sounding 
^ ^letters in words, and exaggerating but not distorting the sound, she , 

' / might teach the child to "sound" each letter in a word (i.e.i 
. buh-ah-tuh. = bat). This approach to sounding results in the mispro- 

foundation of the word and possible loss of meaning because of the 
mispronunciation. * * . . ^ 

•I ' ' Conclusions Related to 

I Instructional Material's / ♦ 

i 

I ^ The findings from the analysis of the instructional mastery 

t - * • V 

I Items data forms imply th^t some review, analysis and revision are in 

order for portions of'each instructional segment. An indepth analysis ^ 

foY specific recommendations, in which revisions for upgrading course 

materials are outlined* and carried out, is not within the scope of this 

research. Such detailed reconlig|idation9' can only follow a thorough. 



on-line .analysis ehid check of thre cueing and practice materials, the 
'Strategies ^mp-loyed in presenting the materials, the ^elated technical 
functions and student comments -and performance retfords. The conclu- 
siohs from the materials analysis provide' direction for the revisions 
• analyst, whose job it iJill b6 to utilize the <lirections In revising the 
^urse. . • 

While specifit recommendations for particular items my not be 
justifiable or fully vdl.id at this point, some trends noted In the 
Items ana1ys1s''did^lead. to conclusions from which" tangible, general 
recommendations were made. 

The findings from ^e analysis did suggest that each 'segment 
provided for the mastery of most of the instructional tasks by the 
majority of the'Tearners. 

• ' Conclusions from response latencies, mean number of responses, 
responses on first attenbt . Most mastery items provided only one 
opportunity to respond; conseqfuently, the' mean number of responses to 
an item does not prftvide Sufficient findings from which generalizations 
may be made regarding , the subordinate cueing and practice items. How- 
ever, since the Items were of the mastery type, a mean number of 
responses greater than two (2) denoted some irregularity In .the corre- * 
spending subordinate Items or In the Item Itself. " f" 

In situations where the mean responses for a stud^t werp two 
with' a correct response on the second attempt. It was concluded that 
the wording of the first stimulus was ambiguous or that the related 
cueing and practlceVmaterlais were inadequate.. 
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-.Resfionse latencies were checke^i because it was conjectured that 
after adequate cueing and practice, light pen responses and simple key- 
board fill-in or multiple choice type items could be responded to 
rather promptly. The analysis of the findings lends credibility to the 
conjecture. Students whose response latencies were greater than one 
miwite were> respondnig ,ih most cases, in the keyboard multi-lined 
response mode, or tp a self-evaluation task where some reading of and 
thinking about a model preceded the response. 

Conclusions Related to 
Instructional Strategies 

Xhe self-evaluation strategy . The items analysis suggested 
some conclusions about the use of the self -evaluation strategy. Since 
the stu4ents* sel f-evaluati on > became more congruent with those of the 
author/1 pstructor, the use of this strategy Was deemed an effective way 
of providing for flexibility In sarners* responses and in allowing the 
learned to judge the validity o^^is responses. 

Several of the students sanctioned ^1s strategy in their com- 
ments ab^ specific frames, or In their final comments rn the^ course. 
The popularity of this feature was corroborated by the comments of 
programmers who went through the course as students and by the corments 
from the first testing groups. 

Computer-evaluated multi-lined responses . Computer evaluation 
af extensive-constructed or multl -lined keyboard responses is a strategy 
for which the full effectiveness remains untapped. The items analysis 
revealed wide disparity in computer-evaluated and author/instructor 
evaluated responses. Students were penalized in several instances 
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because the anticipated response sets di^ not include their answer-- 
even though the answer was acceptable. Another problem lay" in the 
structure of the items within a set. "^In 'some instances the programmed 
sets were so rigidln spelling, '^syllabication, v^ord order and exclu-. 
siveness of word choice that the students' responses* were marked . 
incorrect when in fact they were satisfactory. m 

If enough unanticipated responses are reviewed from the student 
performance records, and If they and the other -factors mentioned above 
are accommodated, it is likely that the computer evaluation of multi- 
lined or extensive-constructed responses will prove to be an exceptional ' 
asset since one of the arguments for computer-assisted instruction is 
that the computer can be programmed to^be both tutor and evaluator. In 
some cases, because this capability as evaluator has not been fully 
thvesti gated, students are actually stifled in their attempts to respond 
because they are of the opinion that they must conform to a preestab- 
lished "right and pnly way" of stating the answer. 

% 

Illustrative lessons . Student comments revealed ambivalence 
toward the use o^ the illustrative lessons. On the one hand, most 
student's were very receptive to the idea of being exposed to at least 
one way of introducing letter-sound relationships. The major com- 
plaints T-evied against the lessons were that the lessons were too repe- 
titive, too numerous, and too lengthy. These complaints were judged 
alid. A factor which might have increased the length of the iljlus- 
trative lessons for several of the students was the fact that these 
lessons were serial build-ups. This meant that if the student was 
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Stopped ^anywhere in the series because- of technical difficulties, ter- 
minal schedule or lack of time, that student was taken to the beginning 
of the series--even though he might have been on the sixth of seven 
steps . 

Overview of objectives for each instructional secjiment . Pre- 
senting the objectives at the beginning of each instructional segment 
was concluded to be a justifiable though not fully developed strategy. ' 
Observations of student work and notations of student comments during 
the operational gse of the program led to the conclusion that pre- 
senting general objectfves did not give students adequate, specific 
guidance toepable them to be selective in their note taking or in 
placing their emphasis for review. It is believed mat if the specific 
objectives had been duplicated and disseminated at the beginning of the 
program students would have been better able. to chart their progre'ss 
and partition their instruction more conveniently. In addition, the 
students would have. been provided with a glo6al view of instruction and 
would have been able tp weave their own awareness of the structure' of 
the course. 

Presentation of the 65urse objectives at the beginning of the 
course might also have allowed students to pinpoint specifically which 

objectives they had not mastered and to request review or additional 

\ 

ins'v ction in the related instructional^ area. 

Instructional time . The wide dispersion of instructional time 
for completion of the incourse materials attested to the achievement of 
individualization and to the program's adaptation to different learning 
rates. The disparities in instructional time may also be related to the 

k 1 
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branching process whi^ ^1 iminated some students from various sections 
of instruction and thereby lessened their instructional time. For most 
Of the preservi'ce teachers, phonics content, pbom'cs generalizations. 
Instructional principles and procedures comprlseo an arena of new knowl- 
edge. Consequently, the mean Instructional time required by these stu- 
dents to learn this new. material exceeded' the time generally allotted 
phonics Instruction In the usual structure of a reading methods course. 

Conclusions from Posttest Findings . 

Since this was the first validation run of this instructional 
product, it was also the initial test of the effectiveness of the pro- 
duct on a large scale. It must therefore be acknowledged that the 'crux 
of the discussion of this first trial lies with providing guidelines 
for product optimization. Once the product is deemed maximally epera- 
tional, then further research may be undertaken to determine how well 
the product functions relative to other products. 

Materials validation . The posttest performance of the top 80 
percent of the validation group led to the conclusion th&t the course, 
In 1ti present form. Is a valid instructional package and may be 
alleged to guarantee similar performance from future groups typical of 
the validation sample. It was also concluded that phonics content, 
phonics generalizations and the principles and procedure! for teaching 
letter-sound relationships are accommodated well by computer-assisted 
Instruction. 

Several factors of note warrant some discussion here. At least 
four students were "recalled" because they failed to complete the post- 
test. Since participation In the program was voluntary, a minority of 
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the students simply "went through" the course and expended little 
effort in conscientiously attending to the instruction. The course was 
designed as a unit of instruction for a preservice methods course and 
would require the same efforts for achieving the objectives ds would 
any other formal unit of a course. Some students viewed the course as 
an "exposure to CAI" rather than as a learning experience in phonics 
from which they would be required to demonstrate competence. A situ- 
ation in which the learning is more purposeful and related to the stu- 
dents '^lassroom objectives must be maintained to appropriately test 
the course's effectiveness under the conditions for which It was 
designed. 

* 

Criterion test items analysis . The conclusions drawn pertinent 
to each test item which did not meet the established criterion level, are 
presented in the following discourse. 

Neither of the mastery items, from the incourse items analysis, 
related to question 1 had difficulty levels less than 80 percent.* This 
condition implied that the majority of the students demonstrated com- 
petence during the instruction. The test item itself appeared clearly 
worded with appropriate directions; hence, it was reasoned that perhaps 
some learners did not meet full criterion on the test item because 
additional reinforcement was needed in the program. 

Objective 30, measured by question 2 of the criterion test 
(posttest) was met in full by 55 percent of the students. The compete 
course implied the sequence for presenting phonics content, so that 
the analysis of no single factor would reveal judgemental information 
relative to the item's ineffectiveness. A closer analysis of the 
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students' responses showed that more than 80 percent of the students 
attained at least four of the possible points on this question. Since 
this performance was close to criterion, it was concluded that more 
closure should be provided by the course, possibly through the list of 
objectives, so that students will know exactly what is expected of 
them* 

Question 3 measured objectives three and four. Since only 64 . 
percent of the learners met full criterion, on this test item, the ' 
related mastery items analysis charts were reviewed. The difficulty 
levels of the major instructional tasks shown for Segment II, revealed 
that the items were at a difficulty level suitable" for at least 93 
percent of the learners. Because the test question- was judged clear 
and the instructional materials suitable, and because 97 percent of 
the learners gave, satisfactory definitions of a consonant blend (objec- 
tive 3) it was concluded that the learners did not make use of the 
mnemonic devices for naming blends that was suggested during the . 
inJtruction. It is likely that the jobjective itself warrants revision 
in this case. It may be, that in dealing with the names of blends, 
recognition, rather than*recall, is a more suitable cognitive test. 

Question 4 was comprised of three parts. Part a, which 
required defining a consonant digraph (objective 5) was met in full by 
100 percent of the Reamers. All the' digraphs were named by 22 or 61 
percent of th^ learners; but only 17 or 47 percent responded to part c 
which required that they give the letter which represented digraph 

sounds that were not the same Ijtters (or in the same order) as those 

'J 

making up the digraph. The instructional items for part b (naming 
digraphs) were reviewed. Several of the items (cf33a blr, cf33b blr. 
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cf33c c7r) were starred as having undesirable difficulty levels. In 

* ' # 

as much as the instructional items relating to the task were all at a 
satisfactory difficulty level, it was concluded that the test question 
was poorly worded and faulty. • 

Questsion 6 measured objective 9 and required that the student 
state the generalization for short vowel sounds in word^. In light 
of the fact that 24 of the students '<net full oriterion and 34 met 
partial criterion, and because the Instructional items related to this 
objective were all at a satisfactory difficulty level, it was concluded 
that neither the test Item, nor th^ Instructional items were fault^. No 
revision was deemed necessary. 

Question 8 measured objectives 10 and 11, The instructional 
items for both objectives were r^viewed in that only 14 percent of the 
learners met full criterion. Unsatisfactory difficulty levels were 
nqted in 11 of the 21 mastery items. This situation suggested that the 
instructional sections dealing with these concepts are weak and warrant 
revision. The posttest item also appeared to need revisions. ' 

Questions 10, 11 and 12 dealt with the generalizations gov- 
erning long vowel sounds in words. Question 10 (objective 13) was 
answered by Ifi of the learners; 12 learners named at least four of the ' 
five features tested for. Since 83 percent of the learners presented 
this nunibef' of the features tested for, and since thef instructional 
items related to the incourse efficiency had a difficulty of 83 per- 
cent, <fche Instructional section was viewed as satisfactory and it was 
concluded that more^concise questioning was in order. 

The same type of response trend cited in question "l5 was, evi- 
dent in question 11, which measured objective 14 and tn question 12 
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which measured objective 15. The learners demonstrated understajjding 
of the'^ concepts during instruction but did not meet criterioti on the 
test item because of the omission of one fejiture. 

Question 16 measured understanding of the -soft c and £ rule. 
Eighteen students met fu^ll criterion; six omitted only one feature and 
met partial criterion. Since the difficulty levels of the instructional 
sections were all 100 percent, it was concluded that most students, had 
derived the rule satisfactorily during instruction. However, the fact 
that thesfe learners had not conditioned thoroughly to all the features' 
implied that some revision of the instructional materials is in order. 

Criterion test Item 20 measured achievement of objective 25. 
A review of the test item judged it clear and sufficient for measuring 
attainment of the objective. The mastery tasks for the instructional 
analysis showed an unsatisfactory difficulty level; only 71 perce.nt of 
the learners presented the task demonstrated mastery on their last 
attempt. It is justifiable to conclude that the materials for practice 
ajid mastery-^of this .concept are inadequate. 

Criterion test item 21, which measured achievement of objective 
26, did not meet the established criterion. An analysis of both the 
Incourse mastej-y Items and of the test item itself revealed factors 
that are implica^ve of the inefficacy of the Incourse practice, cueing 
and kistery items. 

All of the mastery items related to question 22 recorded diffi- 
culty levels at or above the 80 percent level. Since the instructional 
items are satisfactory and since 88 percent of the learners met at 
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le^st parfal criterion .(ue. , omitted no more^ than one feature) it was 
concluded that the Jiscrepancy -1 les in the structure of- the tes,t 
item and not in the instructional materials; ^ 

Question 23 measured the students' abilitij to discriminate oo 
sounds in words. In that 30 or 83 percent of the" learners did 
identify the long and short sounds correctly, and since the difficulty 
levels for all but one of the practice/;r,astery items were satisfactory, 
it was concluded that the instruction was effective but that the test 
item, when requesting the student to use the label "neither" was 
testing a concept which had not,been emphasized during instructiorr. 
In addition, sihce the learners had become sensitized to sounds, many 
of them failed to wnte neUher'and attempted to identify it as one of 
the sounds represented by a letter or a letter combination that had been 
studied in the courses 

The difficulty levels for ttie instructional items related to 
the objective, tested in question 24 were dudged satisfactory and the 
test item was felt to be appropriate. In addition, the majority (33) 
of the students^ demonstrated at least partial competency on the ta'sk^ 
In light of these factors. It was concluded that additional practice 
during instruction might be the remediating influence. 

Question 25 did not meet the 80 percent criterion level. A 
review of the test item rendered it appropriate' for measuring objective 
32;. however, the review of the difficultly levels of the ia^Wtional 
chtcks revealed that althotjgh the principl^Ti^VTltiissed during the 
illustrative lessons, and were pointed out and reviewed on several 
occasions, the students had not had adequate practice in noting^ 
Instances in which the principles were ad^sred to and writing the* 



principles themselves. It wa^ concluded that many learners did not 
meet Criterion fully in citing the principled for phonics instruction 
because they had no,t had the necessary advanced organisers (i.e., 
items for practice that are smaller renditions of the larger mastery 
task) relative to. the behavior required in the criterion test item. 

# 

Although only 26. or 70 percent of the students met full crite- 
rion on question 26, an additional eight learners listed five of the 
six features tested for= Since 94 percent of the learners included at 
least 80. percent of tiie "features tested for, it was concluded that the 
iljpi was satisfactory. A review of the mastery items from the course 
materials analysis! led to the conclusion that the practice and mastery 
items are sufficient but that additional reinforcement may be ^ 
beneficial. 

Conclusions from the 
operations Analysis. Findings 

In view of the findings from the operations analysis,^ it was 
concluded that there were flaws in the development and running of the 
Phonics Program that negatively affected the course and caused errors 
which could have been avoided had the operations been more carefully 
planned and coordinated. 

^ It was also concluded from the operations analysis that lack of 

communication between the author and the technical personnel caused 
several "bugs" in theN^ragram. Ih addition, it was concluded that the 
lack of a definite budget places a project at a decided disadvantage 
during the beginning stages of its development and during the testing 
and revision trials. 

7 
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Sunwary 

It was concluded'that the development of , this CAI Phonics 
Program was. an imperfect, but earnest attempt to provide individu- 
alized instruction in phonics to preservice teachers. The general 
conclusion drawn is that the combination of the instructional mate- 
rials, the instructional strategies and tactics provided for a course 
which was effective and appropriate for the listed objectives, v. 

Recommendations • 

The recommendations are listed under the same general headings 
as the conclusions. The recommendations were generated from the con- 
elusions drawn from the findings and from the wrfter's personal experi- 
ences in developing a CAI program and running a study in a computer- 
assisted laboratory. 

Recomnendatlons; branching based on pretest. performance . It 



is reconmended that the pretests be maintained as a part of the Phonics 
Program. The pretests appear to be reliable measures of a student's 
fami\iarity with a concept and eliminated unnecessary instruction for 
student^ who had demonstrated competence with a concept. 

It is recommended that poorly written pretest items be rewrit- 
ten so as to provide more strucUire^ to the stimulus and that the answer 
processing be updated so that spelling errors, misplaced lightpen 
responses and undesirable keyboard responses may be accorrmodated. 

The technical difficulties cannot be avoided; it can only be 
suggested that alternatives for dealing with such difficulties be* known 
and used* 
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It is recommended that the problem of undesirable responses 
during the pretest be alleviated by having a specially designed **How 
To" section written for the Phonics Program. 

It is further rgcommended that the students b^ Instructed at' 
the beginning of the pretest to. type "don^'t.know" to multiple letter 
or multiple lined responses; and tha^: with multiple choice items, a 
"don*t know" chofc^e be added. Feedback could be programmed especially 
for this input and save the student unnecessary time. 

The final recommendation for the use of the pretest and the 
branching strategy is that they be used again with the suggested 
revisions. 

« 

' Recomtnendation for upgrading pre$ervice phonics training . The ' 
one recommendation generated by the conclusions from the preservice 
teachers' knowledge of phonics is that intensive, individualized 
phonics instruction be a part of the reading methods course. It- fs 
recommended fo«" those institutions having the IBM 1500 facilities that 
the CAI Phonics Program be Jmplementedas d unit for preservice^ reading 
methods courses so that larger samples may test the course and thereby 
advance course optimization. If is also recommended that the course 
Documentation be used' to generate some alternate plan for individual- 
izing phonics instruction for those institutions that do not have com- 

I 4 I 

puter facilities. . " . 

Recommendations for incourse materials . The one recommendation 
encompassing the Uems analysis for each segment is that each starred 
item on the items analysis chart be reviewed and analyzed. The final . 
scheme for materials revision wiVl be up to the individual revisionist. 

r 
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However, it is strongly suggested that the mastery item and,the cueing' 
and practice items^be grouped. The first check should be in the domain 
of the" cueing items; if no discrepancies are noted there, the practice 
items should then be reviewed tp make certain that e^nough of the gppro- 
'priate kinds of practice are provided for application and reinforcement 
of the concept. If the mastery item does not have parallel remedial 
materials available, it is recommended that remedial loops be added and 
that students be branched to the remedial instruction until their first 
response to the mastery item is 'satisfactory. If remedial loops are 
available, then thfese loops warrant some investigation. 

The recommendations above appl)f to all starred items on the 
items analysis forms. A search of the starred items on the forms in 
Appendix H will ^reveal that the markings are not limited to items with 
difficulty levels below 80 percent. Several it|ms were starred because 
the number of\correct responses on the first attempt would not have 
rendered a satisfactory difficulty level .'^ Ideally, mastery of a task 
should be demonstrated on the fjpst attempt if cueing and practice " 
materials areNappropriate. 

Recommendations for use of instructional strategies . The 
recommendations for the use of the instructional strategies are enu- 
merated below: ' ^ , 

1. It is" recommended that the self-evaluation feature 
maii^tained in tfrt^ program and- that further tnves^ig^ition be made into 
•its viability for'tHis. program. 

2. It is recommended that the ans^wer processing -for the 
Phonics Program's computer-evaluated multi-lined responses be '* 
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continuously updated and that this computer capability be researched 
with the Phonics Program so as to generate a possible prototype of set 
development for computer-evaluated multi-lined respoijses for thii; and 
other programs. 

3. The recommended revisionary tactic for the illustrative 
lessons is to present the ffVst illustrat^ive lesson, stress the pro- • 
cedures and principles, acknowledge tf^ommonality%f the procedures 
and principles for all phonics content, and then provide the students 
with the option to review ensuing lessons. The mastery check on the 
procedures would of course be maintained; then if a student djd not 
demonstrate mastery of the incburse task, the additional lessons would 
be, for that student, a part of his remedial loop. ■ 

4. It is recommended that the students be given copies of the 
course objectives after taking the pretest so that they might have a 
more specific .supplement to the general objectives presented with ea<^h 
Instructional segment. 

Instructional time. It is recommended that the instructional 
time required by the validation group be consideration in future 
course testing-and scheduling.' In addition, 1^ is recomtended that the 
students taking the course be taught to read the "anticipated hours" 
printouts so that they will have a more definite Idea of ' the amount of' 
time they will need In the Instructional program based on the time for 

completing the first segment. ' 

i 

Recommendations for po stcourse mjrterlals . The recomnendatlons 
deemed justifiable for pettiest materials are enumerated below. . 
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1. It is recommended that more emphasis be placed on the con- 
cept of a logical sequence for presenting phonics content, during 
instruction. It is also recommended that the test item (questi'on 2) 

'be revised and clarified. 

2. It is recommended that objective 4 be rewritten to 
require- recognition rather than recall and that the criterion test 
item (question 3) be revised accordingly. 

3. It is recommended that the instructional materials for 
question 4 be rewritten according to the investigation of the revisions 
analyst, that the objective be rewritten to require recognition rather 
than recall. It Is'also recommended that\he test item be revised to 
measure the new objective. 

4. It is recommended that for all items which are scored 
according to features present, that the features to be tested for be 
made known to the students prior to the posttest (possibly through the 
objectives or possibly as a prelude -.to instruction). This recommenda- 
tion applies to all test items which measured competency in stating 
generalizations, in defining elements or in describing the,qual ities of' 
sounds. . , • 

c 

5. 11; is recommended that the posttest items which are scored 
according tn features present be more in the form ^f completion ques- 
tions rather than the present short \nswer question. 

6. It is recommended that the instructional materials related 
to definitions, descriptions, andoin statements of generalizations be 
reviewed to insur^ that all the necessary cues are present for stabil- 
izing the features tested for.' 



7. It is recommended that question 22 be restructured to ask 

»' 

for specific features. 

8. It is reconmen^ed that the word in' which the oo combination 
represents neitherv^the long nor the short sound be removed from the 
.test item. 

9. If is recommended that the posttest be broken down into 
sections according to the instructional segments and that students be 
tested at the completion of each segment with smaller tests rather than 
with the longer test during one session. 

Recommendations resulting from the operations analysis . The 
recommendations from the- operations analysis are enumerated below: 

.^1. It is reccrmended that a ver^ close working relationship 
with all personnel be established at th^ outset of the project. 

2. It is recommended that a plose working relationship be 
established with other project directors and coordinators so that 
maximum cooperation may be maintained. This would upgrade efficiency 
in production areas where personnel' are responsible to all projects 
and^would make for better scheduling and terminal usag^. 

3; It is recommended that all projects have definite assur- 
ance of funding before course development is begun. 

4., It is recommended that all changes* in audio, images, or 
programming be noted in written, dated corrmunications between the 

author and programmer. 

» 

5. It is recommended that no last minute changes in program- " 
ming be suggested by the author unless a.dequate time for testing is 
available. 
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6*: It is recommended that at least six weeks advance notice 
be giyen for the final production of image reels. 

7. It is recommended that a minimum dlf three weeks be allowed 
for final audio reel production. ^ > 

8. It is recommended that the course author be trained to 
make simple, on-line corrections, that he be thoroughly familiar with 
the capabilities and functions of the system, and that he be knowl- 
edgeable of the duties of related personnel. 

General Recommendations 
for Future Research 

The implications for future research are confined for the most 

part to tne Phonics Program. That is to say, the research suggested 

wm be towards course- optimization. It is recommended that the 

, course be field'tested with the specific recommended revisions cited 

in the Aforementioned sections and that the following conditions be 

established: . • ' "'^ 

1. The. program will be a required unit of instruction for 
preservice reading teachers in the reading methods courses. 

2. The program will incorporate a "mastery model" whereby 
each student will continue instruction^untl V full mastery of each 
objective is achieved. 

3. The posttest will ^^dapted for CAI presentation. 

4. Th6 retest validation level will be 90/90. 

In addition to the four general recommendatiorvs cited above 
for coursi optimization, four out-^f-program research questions 
evolved. ' 



/ 
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5. It is recommended th?t some type of consequential evalua- 
tion be done with students who complete the Phonics Program in order 
to ^determine what effects the computer-assisted instruction program 
has on the behavior of the preservice teachers in a tutoring or class- 
room situation. 

6. It is recommended that a follow-up project be developed to 
determine the retention of phonics content gained^4*^fnputer- 
assisted instrtfction. --^ 

.7. It 4s recommended that additional learning variables be 
corre>ated with computer-assisted instruction capabilities so as to 
generate models for optimizing the accommodation of learning modes and 
other individual characteristics. 

8. It is recommended that the minimum number of testing groups 
for-a CAI program be three and that each group have a minimum of 15 stu- 
dents Who are representative of the population under concern. 
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APPENDIX A 

DESCRIPTION OF THE IBM 1500 INSTRUCTIONAL SYSTEM 
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This IBM 1500 Instructional System was- designed specially for 
instruction. The system is loc'ated in Chambers Building at The 
Pennsylvania State University. The system consists of 30 instructional 
Stations, each wi th-.d <cathode ray/ tube display, a light pen, and a type- 
writer keyboard. Each station 'hits an audio record and playback device 
and an image projector. / 

The main instructionajl medium is the cathode- ray tube (CRT). 
The cathode ray tube is si/ilar to a small television screen on which 
Itaes of text and other line drawings appear. The CRT, which is the 
main interface between the student and the computer, has a screen area' 
equivalent to 640 display positions. There are sixteen horizontal rovys 
and forty vertical columns. The random access disk provides information 
on the screen in microseconds. The learner may respond by using a light 
pen device which is attached to the CRT or by typing in an answer on the 
typewriter- like keyboard. Four dictionaries of 128 characters each can 
be used either for programming or for a student's response.. 

Another medium for presenting course materials is the IBM 1512 
image projector. The projector accommodates 16mm microfilm reels and 
can show 1,000 still photographic images in both black and white and 
color. 

The IBM 1506 audio play/record unit plays pre-recorded informa- 
tion from four- track magnetic tapes. -The audio messages are coordinated 
with the other instructional presentations and allow the student to 
record responses which the Stude/it can compare to models or which may be 
analyzed after the student has completed the course. 

The central processing unit (CPU) is the main support equipment 
and provides storage of data. The 1442 card/ reader punch Is used to 
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input course content from punched cards and tp pQnch out previously 
stored course content. A 1403 printer lists course content for use by- 
a prograiTiner or instructor, the 1133 multiplexer coordinates .disks, 
tipes, and the instructional devices." The 1502 steuiion pentroi unit 
relays messages from the ijistructional stations tcv-the central -proces- 
sing unit. There are\t$^^10 disk storaje-'^rives. Disks containing 
magnetically stored data operate m^ese disk drives, there. are also 
two 2415 tape- drives whicH/Sfore surh data as studer^t performanc^ 
records. The 1518 typ6w(iter is an input device much Tike the keyboard' 
on the 1510. It can also t^^ejjut course information on paper. The 029 
card punch is used ^or punching codes on standard data processing cards. 

The CPU,>/hich can accommodate up to thirty- two student sta- 
tions with these four instructional devices, contains 32,78^ sixteen-bit 

* « 

"words" of core storage. The 2310 disk drives, which store usable 
course information and operating instructions,, consist of 2,560,000 
characters. The core storage cycle time for the tape drives which 
record the interaction between the program and the student for_later 
analysis and course revision is 3.6 m1crbsecon(;ls. • Thfe 'cead/vic4te time 
for disk storage is 27 A microseconds per word. ■ ' 

Since the computer can record and recall student responses (the^ 
number of correct answers, tfje number of wrong answer^, and so on)„ the. 
sequence of instruction for a particular stu'dent'can be altered on the 
basis of his responses. More challenging material or remedial instruc- 
tlon may be presented on the basis of past performance, o^ sections of 
the course may be skipped if the student's performance is at a specific 



164 



level of proficiency. When a student signs on again to a course after 
having once signed off, he resumes his instruction at his earlier sign- 
off point. 

The computer can be used to record- a variety of information for 
all students, e.g, , the exact contents of his response, the number of 
seconds he takes to respond, and his exacC positioji in a course. 
Summary information such as number of correct responses to a question - 
and total number of response attempts may be produced for analysis by 
the instructor, thereby reducing the teacher's clerical duties and 
freeing him to give individualinstruc^ion. 

The computer will accept course content in two ways: l)^punched 
on cards, or 2) ^nput directly from the instructional station keyboard. 
Using the second method,. the contents of a course can be replaced, cor- 
rected, or deleted easily and quickly by special author conmands. " 

Configuration of tfl^^ystem is shown in Figure 3 on the 
following page. 
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Fig. 3. Configuration of the CAI system. 
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SCOPE AND SE iUENCE OF INSTRUCTION 

PHONICS FOR PRESERVICE TEACHERS: 
CONTENT AND INSTRUCTIONAL PROCEDURES 

Unit I 

A. ' Over^'ew 

1 . Purposes of counse 

2. Phonics: definition and importance of to children's success 
in reading 

8. Readiness for Phonics Instruction 

1. Auditory discrimination between speech sounds in words 

a. explanation of auditory 4iscrimination 

b. implications for children's success in phonics instruction 

2. Visual discrimination between printed letters 

a. explanation of visual discrimination 

b. implications for children's success in phonics instruction 

3. Sight vocabulary for phonics models 

a. explanation of for phonics instruction 

b. rationale for developing for phonics instruction 

^. Letter names and shapes as tools for cormunication in the 
teaching-learning process of phonic analysis instruction 

C. Consonant Sounds: Represented by Single Letters 

1. Key words for common sound represented by single letters with 
inore than one sound 

2. Rationale for teaching consonant sounds first 

3. Logical sequence for teaching -consonant sounJs 

4. ILLUSTRATIVE LESSON: C 

f 

a. procedural steps for introducing single, initial con- 
sonant letter sound 
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b. principles to be observed in introducing sounds 

c. objectives in teaching 

5. ILLUSTRATIVE LESSON: Initial consonant substitution 

a. procedural steps ^ 

b. principles to be observed in letter-sound instruction 

Unit II 

Consonant Sounds: Blends and Digraphs 

A. Consonant Blends 

1. Distinguishing quality of consonant blend 

2. Two-letter consonant blends^ ~brr cr, d£, fr, 3^, £r, tr, bl , 
-£L» IL> £i> lL» sk_, sm, sn_, S£, st^, sw ~ 

3. ILLUSTRATIVE LESSON: Consonant Blend 

a. procef^ural steps 

b. review of principles observed 

c. review of objectives in teaching letter-sound relationships 

4. ILLUSTP<\TIVE LESSON^^Cons^onant Blend Substitution 

a. procedural steps 

b. review of principles observed 

c. review of objectives in teaching letter-sound relationships 

B. Consonant Digraph 

K Distinguishing qu^^lity of a consonant digraph 

2. Consonant digraph: sh, wh, th, ch, in£, £ih^, ck 

3. ILLUSTRATIVE LESSON: Consonant Digraph 

a. procedural stepi 

b. principles observed 

c. objectives in teaching digraphs 

1' 



169 

Unit III 

Syllabic Principles, Vowel Sound Generalizations 

A. Syllabication 

1. Definition of process 

2. Relation to phonic analysis 

3. Rules for syllabication 

a. there are as many syllables in a word as there are vov/el 
sounds 

b. syllables divide between double* consonants 

c. single consonant between vowels usually goes with second 
vowel 

d. do not divide consonant digraphs and blends; treat as 
single consonant letters 

e. endings cle_, ble, fie, £[e^ tie, etc., usually comprise 
final syllable 

B. Y and W as Vowels 

C. Short Vowel Sounds 

1. Key words for short vowel sounds 

2. Generalization for sounding a single vowel which does not 
conclude a word ' 

3. Generalization for a single voweT In medial position 

4. Approaches to teaching short vowel sounds in one-syllable 
words 

5. ILLUSTRATIVE LISSON: Short Vov^l Sounds 
a. procedural steps ' 

"b. principles observed 
c. objective: of teaching 

D. Long Vowel Sounds: Single Vowel Letters . \ 

1. Key words for long vowel sounds 

2. Generalizations for long vowel sounds 

\ 
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a. final e generalization 

b. single final vowel generalization 

c. adjacent vowel yeneral ization 
3. ILLUSTRATIVE LESSON 

a. procedural steps 

b. principles 
^ c, objectives 

Unit IV 

Vowel Letter Coinbi nations 

A. Digraphs , \ 

1. Distinguishing feature of vowel digraph 

2. Regular or consistent vowel digraphs 

3. Generalization for sounding adjacent vowel combinations: ai 
^» ^« oi» 2i , 

4. Outline of .;procedural si:eps for teaching digraphs 

B. Vowel Diphthongs 

1. Distinguishing quality of a vowel diphthong 

2. One sounjl vowel diphthongs: oi_, oj^ 

3. ^wo scfimd vo'%1 diphthongs: ow, ou^ 

4. Hints for sounding ^ 

5. Suggestions for teaching / 
Unit V 

Consonant Irregularities 

A 

A. Hard ant! Soft Sounds of and 

B. Sounds Represented by x 

C. "Silent Consonant Letter" rules: kn, £s_^ ah. VjT, mb, bt,, c|n, tjm 



.er|c 



) 
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Unit VI 

Vowel Irregularities 

A. The schwa sound 

B. R-controlled Words 

C. A followed by u and w 

D. The 00 sounds 

E. 0 followed by Vd 

F. j_ followed by n£, gh , ' 1 d 
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EXAPIPLES OF COMMENTS. FROM THE FIRST TESTING GROUP 



I. aa28a 



2. ca094 

3. ca03a 
ca04a 

4. aa78a 



5. aa74a 



6. cfpPl 



7. v)p02 



8. cfl7a 

9. ca38a 
ca41a 

10. cflla 
11. 



a) Too much* time; give more cues 

b) If a person doesn'*-. know after the first time, 
does he get out of it? 

Simply done - good! 

4 



Well done - clear 

Why don't you givfe the feedback question initially 
rather than waiting till someone guesses wrong first? 
It would guide the response and save time. 
Audio,message was quite a bit of material to assimi- 
late. Could it be boiled ddwn and presented on 
screen? * 

How about a lightpen Tnstead of keyboard response for 
first question? 

I'm not "^ijre whether I agrfee with all these con- 
structed generalizations. I guess it depends on your 
objectives. Some are pretty damn hard for a 
retardate to construct. 

Good frame - well worded and excellent feedback. 

Once again too much a«;ked with too few guidelines! 
Great teaching technique - mnemonic devices! 
Some introduction to the pretest (reason for, etc., 
may help ease the shock). 
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12. da50a Keyword technique vague; concept yjping described is 

not quite clear to me. 

13. aaSla Too much practice; perhaps it is unnecessary to go 

thru each of the consonants and type a key word? 
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DEGORIPTION OF MAJOR. COURSE STRATEGIES 'AND TACTICS 
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EXAMPLES OP STRATEGIES 
UTILIZED' IN THE PHOIil PRC^^RAM. 



A Branching Based on 
Pretest Performance 

With this str>3tegy, 'tj>e student was introduced to the progVam 
» / 

and given a diagnostic tes^t based on the terminal criterion objectives. 
According to the results of the test the student was branched to 
instructional iegmervts or to sections within segments on which the 
criterion level :>^d not been attained Chapter 11.1 contains an illus- 
trative discussion of th^is strategy, 

B. Student Overview of Prete:3t ^ 
Achievement and Instructional 
Objectives ^ ~ \ 

/ 

Broad objectives were^ presented to each student at the^begin- 

mng of each segment. These objectives overviewed what was to be 

gained f<om the instruction. A summary of student knowledge ^elated 

to the particular instructional segment and based on pretest perfo»^m- 
ance ./as e ' so given 



C Studpnt-Prgci SI on-Based Instruction ^ ' ^ 
Review anc(/or Practice 
*> 

In some instances,' students were given th'e choice of receiving 

^ levjew of information already atl^amed, of receiviR^ additional 

ijjformation on a topic, or of receiving a Vepetifion of prit>r informa- 

f 

ti-on. For some tasks, the student decided whethe*' he would skip the 
task or in what mode he would /-fespond to a task Also, much of .t,.e^ 
practice related tu an instructional concept' was left to the student's 
perception of his needs, 

V 
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D. Student Self-evaluation - ^: 

From ^ Mode l ^ 

At various points in the program, students evalwa'ted and rated 
their responses based on models presented/ This strategy allowed for\ 
flexibility in student responses of multi-lined, x)pen-ended responses.' 
A student. would answer a question, formulate a generalization or prin- 
ciple, analyze. a situation or prescribe instruction vn a hypothetical 
.situation He would then see a model il|ystrating an acceptable 
response; , in' some instances, several ways of responding would be shown 
in" the model*. The student^ would match the idea in his response with 
the idea in the mpdel and evaluate his response as being the 'same' or 
'differertt' in meaning as the idea illustrated in the model,. 

t, student-constructed . • ^ . ; . - / 

Mglti-ltned ResponFes 

One of the major response mode'§ was the multi-line refsponse 

mode in which a student was required to provide all 'of the answer to/lT 

question rathec' than supply Words or p^rases, or make correct 'choices 

from a gr6up of items. This type of response mode forced the student 

'ta synthesize information and communicate liis understanding of the 

infbmiation/^fn''^ raore sophisticated manner. , ' ' J 

. ^ ; • . - ■ ■ 

•F. Computer Evaluation of 

Extensive Constructed Restfohses 

^ In order to have the' computer evaluate totally constructed 

responsjB^ sets>of key words'which could be accepted as a part of the 

Correct response were developed.* Then the computer was programmed to 
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accept a combination composed of one of the key words from each set as 
"colrrect."' For some responses, more than forty-five key word synonyftis 
were in a set. 

G. Use of mustrative Lessons for 

Demonstrating Principles and^ — ' 
Procedural Steps 

Since one of the objectives in deve^loping the course was , to 
provide the preservice teachers with one model for introducing letter- 
sound relationships to children, brief illustrative lessons were shown 
using different phonics content. During the illustrati^ lessons,' pro- 
ceduraL steps and principle ob'servedv were pointed out. The mastery 
t*sk related to this^area required the student to select jan item and 
take it through the (procedural steps. 



H. Inductive Approach * • 

The predomijiant strategy in 'helping the preservice teac+iers 
learn the generalizations for vowel sounds and the rules for sounding 
other letter combinations was inductive.. The students were given the 
examples of the concept and then given the label. From these cues, the 
students. formulated the generalization, description or rule. In some 
vtasks; the learner was presented a situation and led to reason out the 
concept related to the situation. 

I. Modified Simulation fOr 
Developing Insight's 

Ii^ order to develop the celation'ships between the readinessc 

prerequisites ^nd phonics instruction, the students played the role of 

a beginning reader. The student had to learn "sight wocds" fnom a 
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foreign symboj system; they Tiad to take a test on auditory disc/imina- ^ 
tion; they had to visually discriminate between "words" that were 
similar except for one symbol. 

J. Wide Range of 

Questioning Formats * ^ 

In addition to conventional response modes (i.e., multiple 

xhoice, fill-ins) the program presented several unique question 

formats. The multi -lined student-evaluated responses and the multi- 

lined or extensive constructed responses have been discussed above. 

Another notable questioning format is described here. This type format 

checks answers according to the structure; tfiere is no right or wrong. 

For example, in testing a student's understanding of the' voweT sound 

represented by ^^at the end of a one-syllable word with no Other vowel , 

the edit function searched- for consonant, consonant,'^, or Consonant, 

consonant, consonant,^. The possible formats were known and even if a 

"real" word were not typed, but conformed to "tfTe format, the student's 

I , ' * » ^ 

response was judged cqrrect. This strategy proved highly successful * 
when used in the course. ' ' / 
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Flowchart of Instructional Process for Phoni 4 (continued)^. 
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PHONI PRETESTS 

s 

PRETEST 1 

Before a child can profit from instruction in phonic analysis, he 
must have acquired Certain skills and knowledges and developed cer- 
tain abilities. Look at the list of skills, abilities and knowl- 
edges shown on the image. Type the number of each statement that - 
is one of the four prerequisites for phonic analysis: 

[1] [13] [15] [19] 

(Criterion 3/4; .5 points for each correct answer) 

1. auditory discrimination between speech sounds 

2. is skillful in using the context for word meaning 

3. has a meptal age of at least five years 

4. has good vision 

5. can speak and understand standard English 

6. is familiar with many common objects 

7. has adequate motor coordination 

8. has developed in psycholinguistic abilities 

9. is skillful in printing letters 

10. has a rich and wide experiential background 

11. demonstrates good classroom decorum ^ 

12. has a wide reading 'vocabulary 

13. can recognize and discriminate visually between printed letters 

14. knows the ''basic sight'' words 

15. can^recognize some whole words in written form 

16. knows common word patterns in sentences 

17. knows basic pri^nciples of syllabicatipn 

18. knows numbers from 1-10 



225 



19. knows letters of alphabet by name ana shape 

20. is articulate and fluent in speech expression 

To what does audi tory discrimination for phonics instruction refer? 



[Ability to hear fill sounds in the spoken language] 

To what does visual discrimination for phonics instruction refer? 
[Ability to see similarities and differences in printed letters] 



Why does a'child need to khpw the letters of the alphabet by name 
and shape for phonics instruction? 

[To help in identifying correct sounds] 

[To see that each letter stands for a particular sound] [1 point] 
[To facilitate communication in the teaching-learning process] * 

Why is the child's ability to recognize some^^whole words in printed 
form important for phonics instruction? 

[To provide reference points for introducing letter-sound 
relationships] 

[To help the child understand the concept of a word] [1 point] 
[To facilitate pupil -teacher communication] 



[Ability to distinguish whole words in spoken form] 
[Ability to distinguish between sounds in a word] 



[1 point] 



[Ability to recognize printed letters] 
[Ability to perceive the whole word as a unit] 



[1 point] 




[Total Points = 6] 
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PRETEST 2 

* • - <» * 

1. The sk in sk^id, the cr in' cream,. and^ the fl in floor are examples 
of: _ 

[ consonant blends] [consonant digraphs] [cq(nsonant plosives] 

[1 ^o^nt] 



2. Look at the four statements on "the image. Type the number of the 
statement wHich'best describes a consonant blend: 

[a combination of consonant letters which stand for a single, 
distinct sound] 

* 

[ a consonant letter combination in^which the individual consonant 
sounds are distinguishable in the resultant sound] i 

[a consonant letter cpmb^i nation which represents a sound unlike 
either of the single consonant sounds involved] 

[two consonant letters Which ar^ sounded as one letter] 

[1 Point] 



At the beginning of each row below is one of the letters that'"is 
common to a group of consonant blends. Type all consonant blends 

with each ."blender" on the respective row. Enter when you finish 
each Vow: 

i [bl. cl, fl, gl,,pl, si] 5/6 = 1 point 

r [br, cr, dr, fr, gr, pr, tr] 6/7 = 1 point 

s^ [sc, sk, sm, sn, sp, st, sw] 6/7 = 1 'point . 

[3 Points] 



[Total Points ^ 5] 



•^4 
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PRETEST 3 

V 

1. Type the Consonant combination in t|ie word phonograph other than 
^r: 

- ph 

[No Points] 

2. You have indicated that the letters gh^ in tH^ word phonograph are a 
consonant combination. Type the name of this\ combination if you 
know it. Type the words "don't know" if you dp not know its name: 

consonant digraph 

[1 Point] 



Of the following statements, choose the one that most accurately 
describes a consonant digraph: 

[two consonant letters whiiQh are sounded together] 

[a combination of single consonant letters whose sounds merge to 
form a single sound] 

[ two consonant letters, representing a single, distinct sound that 
may be unlike either smqie letter soundj 

^ [1 Point] 

Six«digraphs are fomied with the letter "h." Type these six "h" 
digraphs : 

flh 2lL sh wh th ch . 



5. One digraph is formed with the letter £; type this digraph: 

6. Type the end digraph that is formed with the letter 1<: 
ck 

/ ^ * [8/8 = 1 Point] 



Next to each digraph, type the letter or letter combination that 
represents the digraph sound(s) as illustrated in the key words: 

ch^ chaos (k) wh where (hw) or (w) 

£h pliohe (f ) , > 

Sll • rough (f ) 

, ' [3/4 = 1 point] 

[Total Points = 4] 

< . ■ 
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PRETEST. 4 

What is the same about the vowel sounds in these words? 

cupdap. dollup fedmipf' llslep 

[long vowel sound] [wdial vowel sound] 

[ short vowel sound] - [schwa sound] 

^ [1 Point] 



Put on* your earphones to listen to. some words containing vowel , > • 
sounds. The words will be given in pairs. Type one of the words 
from the pair which could serve as a key word for^ the short vowel 
sound: a_, e, i, o^, Type the word ynder the vowel letter whose 
short sound isnieard: 

AUDIO MESSAGE 
[5/5 = 1 Point] 



Complete these phrases to construct the generalization for the * 
vowel sounds in cat and imp: 

^ fa vowel I • 

\a single vowelj 

In a word or syllable in which there is ^ only one vowel ' * 

which^ is in the "medial or initial position of the word or syllable, 
is in the middle or beginning! .^.^ / ^^^^^ 

is not in the ending [ • ' .'^"""^ 

[3 Points] 

[Total Points = 5] 
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1, 



PRETEST 5 



Look closely at the action 'below: 
gerrymander ger ry'^an der 

haberdasher hab er da%h er 

What do we call the process illustrated? 



syllabication 



2, Retype each of the words in. the space provided. Indicate the 
syllabic division by typing a slash after every syllable except 
' the last, one. 



commiserate 


com/mi s/er/ate 


wadpun ' 


wad/pun 


curbo 


cur/bo ' 


daddop 


dad/dop 


borne 1 


bo/me 1 


si get ^ 


, si/get 



Complete these statements so that the syllabic principle observed 
in wadpun, curbo and daddop is formed. 

When two consonants are between two vowels the first 
consonant ends~the first syllable" and the second consonant 
beglQ^the second syllable, t^oi n ts ] 



Comple/te this statement so that the syllabic principle observed in 
bomel and si get is formed. 

A word haying two vowels which are separated by a single 
consonant usually divides after the first vowel. [2 Points] 

[Total Points = 4] 



( 



4 
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: PRETEST 6 



K There are two consonant letters that represent vowel sounds in 
certay situations; type these two letters: y w 

[No Points] 



2. Type the number of each word below in which ^ represents a vowel 
sounti: • ^ 

{].) lyte 2. yam (3.) eye (4.) gyp 

(5.) heavy (6.) cry 7. your (8.) syzgy 

} 

[No Poijts] 

3. You identifi^^as representing a vowel sound in these words: 
gyp, heavy, cry, syzgy. Type the reason why: 

no other vowel in word or syllable 

XI Point]' 

4. You identified ^ as representing a vowel sound in this word: eye. 
J^pe the. reason, why: y immediately follows a vowel in the same 

syllable. ^ 

[No Points] 



5. What vowel sound does ^ stand for in this nonsense word? 

, skregy l ong*e [1 Point] 

6. Type the vowel sound that ^ represents in this nonsense word. 

myp short i . ^ [1 Point] 

\^ 7. What vowel sound dejes ^ stand, for in this n^)nsense word? 

sry long U • [1 Point] 

8. type the number of each wordrfn, which w stands for a vowel sound: 

1. work (2.) cower 3. wisk - (4.) drawl 5. wait 
(6.) hew (7.) awful [No Points] 
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y Why does w represent a vowel sound in the words ("wer, drawl he^ 
and awful? 

1t immediately follows a v o wel on the same syllaBle. 

[1 Point] 

[Total Points - 5] 



PRETEST 7 

What is the same aoout the vowel sounds in tfiese words'^ 

soak mete mail alo eel 

[blended vowel sound] [ long vowel soun d] 

[double vowel sound] [short vowel sound] 

[1 Point] 

4n each group of words, you will hear one word in which the lony 
vowel sound of one of the vowels is heard. -Type the name ot the 
vowel letter whose long sound is heard. 

1. map, signet, corn, beat 

2. men, whip, laj/_, blouse 

3. useless, ostrich, bit, wham 

4. an, dye , risk, wet 
5» top, oat , wept, slam 

[5/5 = 1 Point] 



Complete these phrases so that they comprise the generalization for 
the vowel sounds in the words on the image. 



hate 

mope 

use 

eve 

bite 



hero 
ni tro 
hi 
be 



meet 
aid 
ray 
bead 



3. When there are two vowels one of which is final e and they are 
separa'ted by a consonant , the vowel sound heard is the long 
sound of first ; and the final e is * "silent" . 

. [5 Points] 



4. When there is a single vowel in a word ojr syllable and it comes 
at the e nd of the word or syllable, the /owel sound is long ■ 

[3 Points] 
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5. In a syllable which contains adjacent vowels the vowel sound 
heard is usually the long sound of first . The second is 
'^silent" . 

[3 Points] 



6. Complete- this modified generalization of the adjacent vowel 
generalization : 

When ai , oa , ay > ee , oe , ea ^ are in the same syllable, 
the long sound of. trie first vpwel is heard. 

(Choose from these combinations: ai, ea, ie, oa, ue, au, ee, oe, 
ui, ay, ei , oi, uy, aw, eu, oo, ey, ue, ew, ou) 



[Total Points - 14] 
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PRETEST 8 

1. What do we call the underlined vowel letter combinations in these 
words? 

to 1^1 loud crowd 

[ diphthongs] . [digraphs] [glides] [schwas] 

[1 Point] 



2. Which statemefit most accurately describes a diphthong? 

[two short vowel sounds, blended] [two vowels that stand, for a 

-/ . long vowel sound] 

'[ two vowels-single blend^ sound ] [two vowels - one vowel 

sound] 

J- 

[1 Point] 



3. What do we call the underlined vowel letter combinations in these 
words? ^ 

deed bea^t la^d hejjght 

[double vowels] [ digraphs] [consonantal vowels], [long vowels] 

[1 Point] 

4. Which statement most accurately describes a vowel digraph? 
[two vowels that stand for the long sound of the first] 
[ two vowels that stand for one vowel sound ] 

[two vowels, long sound of second vowel] 

[1 Point] 
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5. The underlined vowel letter combinations are either diphthongs or 
digraphs. Next to each word, type "1" for diphthong or "2" for 
digraph: 



boil 


(1) 


deed - 


(2) 


boat 


(2) 


boy 


(1) 


laid 


(2) 



^ height (2) 

cow (1 ) 

' snow (1) or (2) 

great (2) 

[10/10 = 2 Points] 
[Total Point?s = 6] 



hou^se (1 ) 



— * 
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PRETEST 9 



(Note: Each correct answer from 2-9 equals .5 points) 

1. What is the same about the underlined consoffant letters 
in these words? 

fummer £nak rhetun -wruph fumb 

[forms consonant combination] [controls vowel sound] 

[begins syllable]* [ silent consonant ] [voiced consonant] 

[No, Points] * 

2. The following statements are situations in which a certain con- 
sonant letter is silent. Read the statements then type the con- 
sonant from those below to which the statements refer: 

(h) is usually "silent" when it: 1) follows or precedes a vowel 
sound; 2) follows the letter r, or L 

c f h s m 1 p 



3. Which consonant letter, when appended to the beginning of the fol- 
lowing woras would not -alter the pronunciation? (w) 

' ring raps rote ry 

4. Select the three instances in which the letter combination gh is 
"silent": , 

[ following the. vowel sound a] [ after the.long'i sound] 

[before the vowel ci_] [ before the letter t] 

[behind the vowel soun3 £] - [before the vowel sound u] 

5. Twfl consonants are silent when they come before the letter n^ in a 
word or syllable: Type these letters (g) . (k) 



6. Type the letter that is ^ilent" in these words: folk, salmon, 
balm, would, chalk. (1 ) 



V 
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7. Which letter is $^''*ent before the sounds represented by s^, t, n^? 



8. Type the "silent letter" rule illustrated in these words: phlegm, 
phragm. 

(a_ before m is "silent") 

9. Touch the word in each row which is the correct phonetic spelling 
' of the underlined word at the beginning of each row: 

A; subtler sublef sutler suiter 

B. cl imb cl im cl ib cl ibm 



10. Touch the letter that represents the "soft" sound of ^. 
(j) s 2 p . 

11.. Touch the letter that represents the "soft" sound of £. 
k b (s) 2 

12. Touch the three letters which control the "soft" sounds of £ and \. 
• ^ a (e) (i) ^ 0 u (yj w 

13. In what position is the e, i, or y when c or g stands for the 
"soft" sound? " 



before c or g ( after c or g ) 



14. Which vowel gives 3^ a sound? 

a e 1 0 (u) 

15. Which letter combination stands for the sound of qu? 

ck Icy (kw) ku 



4 
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PRETEST 10 



A: 

AUDIO MESSAGE: 



/ Listen to the vowel sound in the second syjlable of ex^ich of 
the words 'bel ow: ' 

^button buttan buttin butten buttun 



1. Touch the "term which identifies the vowel sounds in the second 
syllable of each word: 

[schwa] [short vowel sound] [accented vowel] 

[No Point] 

'2. Use your light pen. to touch the statement which best defines the 
schwa sound: 

[accented, one syllable sound] [ softt-ning of the vowel sound ] 
[two consonant sounds stressed] [hardening of consonant s'ftund.] 
^ [1 Point] 

3. In which situation does the schwa sound occur? \ 
[ unstressed syllables ] [monosyllabic words] 
[polysyllabic words] ' [accented syllables] 

[1 Point] 

4. The schwa sound is very much/iike the short sound of one of the 
vowels. Retype the words^below and substitute the vowel letter 
whose short sound is like'the schwa sounu: 

shaken shakun 



elevate eluvate 



[.5 Point] 

5. The schwa sound represents all vowel s in unstressed syllables, 

[,5 Point] 



Which of the consonant letters below affects the sound of each 
vowel? ) 



p m s (r) c ' 

[f Point] 

In which position is the £ in relation to the vowel when it 
affects the vowel sound? fol lows vowel 

[1 Point] . 

/Which term most adequately \lescribes the resultant soumi of a 
vowel followed by r_? . 

[schwa sound] [long vowel soiinrQ [ blended sound] 
[short vowel sound] 

[1 Point] 

. The letters }l and the combination affect tl\e sound of 

^ which of the vowel letters below? 

• (a) e 1 0 u 

[1 Point] 

Which spelling represents the resultant sound of a in all, al , 
or ai[? ' T 

ae ow (aw) 

Group these words according to the sound represented by the 
double 0£: 

boo book good blood floor ccol 

Long 00 : boo, cool 
Short 00 : book, good 
Neither: blood, floor 

[6/6 = 1 Point] 
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; 

E: 

1. In the line below,, three of the words follow a particular rule; 
one word d,oes not. Typ*this word that is an exception in the 
space at the end of theifne: (told) 

bat melt > shop told drum 

[No Points] 

2. You correctly identified told as the exception. Type the gener- 
alization which accounts for told as an exception: 

I (o followed by Id^ staryJs for long o sound) ' 

[1 Point] 

3. In the line below, the vowel sounds in three of t'he words are 
exceptions to a generalization for vowel sounds. ToucK' the word 
in which the vowel sound conforms to the general Ration : 

wild scoff night kind 

[No Points] 

4. Now type a generalization to cover the vowel sounds in the words 
wild, night and kind: \ 

(i followed by ld_, nd_ stands for long i_. ) 

[Total Points = 11] 



PRETEST 11 



Name at least three principles that the teacher shoihd observe 
when introducing lette^r sound relationsh-ips: 

a. exaggerate but do not distort sound 



b. 



cal 1 letters by name 



c. 



never sound letter in isolation 



use^whole words as meaningful stimulus 



[2 Points Each] 



Outline in sequence, the procedural steps in introducing a letter- 
sound relationship: 

•1/ Teacher prints letter«in jjpper and lower case 

2. Teacher prints known stimulus words ' " 

3. Teacher calls visual attention* to similarities 

4. Teacher says each word and directs attention to sameness 
in sounds^ 

5. Children say words / 

6. Children supply other words similar to stimulus word 

[2 Points Each] 

Outline the content of a phonics program in a logical sequence for 
presentation to children:^ 

Twd points are awarded for beginning with single, initial 
consonant letters and three points for inclusiveness and 
.logical ordpr. 




[5 Points] 



[Total Points = 23] 



[Total Points for Test = 92] 
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PHONI POSTTEST 



DIRECTIONS: Answer each question as well as you can. You may ma^^e 
your answers brief apd to the point or you may elaborate; just be sure 
that you include tKe main points. 



Name the four prerequisites 'for phonic analysis and discuss each 
as it relates to phonic analysis instruction. 



sight vocabulary: 
auditory discrimination: 

visual discrimination: 

letters by name and shape; 



serves as phonic models 

hear differences'in souhds in 
words 

see differences in printed letters 
in words 

communication purposes 

[6 Points] 



Outline the content of a phonics program in a logical sequence 
for presentation. Use major headings. 

A. Single initial consonant letters ,[2 Points] 

B. Consonant blends 

C. Consonant digraphs 

D. Short vowel sounds ' [3 Points] 
t. Long vowel sounds <:» 

F. Vowel combinations ^ 

G. Consonant irregularities 

H. Vowel irregularities r- - 

The program stressed begfnning with single consonant 
letters; two points are awarded for this beginning. One-half 
of a point is awarded for each heading Included and one-half 
a point is given'for logical brder throughout. 

[5 Points] 



Describe a consonant blend and name the two-letter consonant 
blends: 

Combination of two or three consonant letters that result In a 
sound that Is a blend of the sounds represented by the single 
consonant letters. 

OR 

Two consonant letters that produce a sound in which the sound 
represented by each letter Is distinguishable. 

f: br , cr, dr, fr, tr 

1 : kl, cl_, fl_, £l^, si s : s£,. sk , sw , s£, sm, sn , st_ 

[17/20 = 3 Points] 

Define a consonant digraph and list^'the consonant digraphs that 
are to be Included In a phonics program: then riame the letter or 
letter combinations representing the digraph jp<jnds which are not 
the same as the letters of which the d1 graph 'is , made. 

a) Definition : 

Combination of two consonant le'Jters that produces a 
single , distinct sound (which may be represented by a letter 
or letter combinations different from the letters of the 
digraph). 

b) Digraphs : 

ch, all, £h , sh, th, wh^, ck , n£ 

c) ch = k gh = f ph = f ^ 

[4 Points] 



Write a word in which the vowel letter represents the short vowel 
sound of: 

Examples 



a^ 


at 


cat 


• 








el 


hep 








it 


nip 








o_ 


on 


cot 








u^ 


up 


' cup 









[2 Points] 



state the general i zati on(s ) for short vowel sounds in words: only 

vowej^ in closed syllab le stands for short vo wel sound ; only vowe l 

at~l )e''ginning of word stands for short vowel sound; only~oweTTn 

middl e of wo rd stands for short vowel sound. 

[3 Points] 

"Syllabicate the following words; next to each v/ord, write the rule 
governing its syllabic division: 

a) drunner - drum/mer: divide between two consonants 

b) beckon - 

c) dortut - do/nut: single consonant between two vowels goes 

with second vowel 

d) ladle - 

[4 Points] 

fiane the instances in which y_ an3 w represent vowel sounds. Then 
desc ^be the resultant vowel 'sound: 

instances vowel sound 

a) y_ - no other vowel in word y_ in closed syllable: short 

y^ and no other vowel at end of 
syl lable; long J_ 

b) w - immediately follows y_ ^t end of two-syllable word: 

same syllable . long e or short 

[5 Points] 

Write one word for each of the vowel letters below in which the 
Ic^g sound of that vowel letter is represented. 

a ra 

e me 

i hi ke 

u fume m 



[2 Points] 
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Write the "final" e generalization and g\ve one example. 

When there are two vowels in a word, one of which is 
final e and the vowels are separated by a consonant , the first 
vowel (usually stands for the) long sound and thVTinal eTs~ 
"^sTTent. " 

[5 Points] ' 



Give the "single-final" generalization and give one example. 

A single vowel at the end of a word or syllable usually 
stands for the lonj vowel sound . 

[3 Points] 



Write the "modified" adjacent vowel generalization: and the vowel 
letter combinations which adhere to it most consistently. 

When these vowel combinations are in the same syllable 
the first vowel usually stands for the long sound and the 
second vowel is "silent, " : eejea^, oe^, en,, a^, oa_ 

[4 Points] 



Describe a vowel dig-^aph. 

Adjacent vowel combination that results in a single , 
distinc t vowel sound, 

[2 Points] 



Describe the qualities of a diphthong. 

Adjacent vowel combination that records a single, blended 
^ound, 

[2 Points] 

♦ 

List the "common" diphthongs and write a >ey word for e&ch 
diphthong sound. (Note: one key word may serve two diphthongs.) 

21 qw 

key - boy ~ key - out 

ox ou 

[2 Points] 
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16 Type the rule governing the sounds represented by £ and £ in 
these words : 

ci vi 1 

gentle 

Rule: When c and £ are fol lowed by e, i , or_7 they represent their 
"soft"^ sounds . 

[3 Points] 

17. Next to each of the consonant letters or letter combinations, give 
the instance(s) in which the letter or letter combination does not 
represent a sound in words : 

b^ after m, before t^ in same syllable [comb, debt] 

h_ before vowel soXind, after r^, at end of word [ah, rhett] 

j< before n_ in same syllable [knight] 

1_ before m, before in same syllable [balm, folk] 

£ before jl> s_ or t_ in same syllable [pheumonia, pseudo 

ptomaine] 

3_ before n^ or m in same syllable [gnat, plegm] 

gh following long i_, long £ vowel sound ^ [night, weight 
before t^ ^ ^ caught] 

w before r^ in same syllable [write] 

Note: Examples such as those given to the right were 
acceptable, 

[4 Points], 

18. Name the l^etter combination whose sound is represented by kw. 

\ [1 Point] 

19. Give a word in which represents its most common sound. 

yes. 

[1 Point] 
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20, Describe the vowel sound in the words below: 
^ bar ' 

her 

snare 

sure 

The vowel sounds in the words are controlled by the 
letter r^ which immediately fol lows the vowel . The sound is 
neither long, or short, but is a "blend" of~ the vowel sound 
and the sound represented by the letter r_. 

[3 Points] 

21, Name the letter combinations which stand for the^ vowel sound heard 
in "brought." 

al 5 ^11 , au aw 

[2 Points] . ' 

22, Describe the "schwa" sound and tell in which instances is occurs 
1n words: 

The schwa sound is similar to a softened, short u sound . 
The schwa sound usually occurs in - unaccented syllables , 
[3 Points] * 

23, Name the oo sound represented in each of the words below: 

hook short ^ toot long 

blood pei ther 

[1 Point] 

24, Give the generalization for the vowel sound in the words below: 

a) Gold - £ followed by ld_ usually represents the long o^ sound, 

b) Light, mild, rind - ^ followed by gli^, ld_, nd, usually stands 
for the long 1 sound. 

[1 Point Per Answer] 



r 
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25. Name at least three prirrciples to be observed in introducii 
letter-sound relationships: 

a) complete word or meaningful stimulus 

b) call letter by name 

c) emphasize but do not distort sound 

d) sound no letter in isolation 

e) associate with both capital and lower case 

[2 Points Per Answer] 

26. \ Give the steps in a general procedur^il outline that could be used 

to introduce letter-sound relationships: 

1. Print letter in capital and lower case 

2. Print several familiar (s^ght) words on board 
^ 3. Ask children to see_ how words are alike 

4. Pronounce words; ask children to listen to sound represented 
by the letter being emphasized. 

5. Have children say words and listen to sound represented by 
letter as they pronounce words 

I 

6. Ask children for other words with same sound (vowel or con- 
sonant) as emphasized in st'-Tiulus words 

[2 Points Per Answer] 

< [Total Points = 92] 




APPENDIX H 
FORM C: INCOURSE ITEMS ANALYSIS FORMS 
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COMMENTS ON THE COURSE, " ' 

A, "Very interesting. • ^ - 

The,general1z4tipns Were harde-sTt for me. I wished there' ' 
«' ^ ^ , ^ 

wefen't so muc/i "writing of the generalizations" - but that's probatrly 
what I need. But as you see from the posttest, I do' rot tend tQ 
remeijiber wordings, but think I .am nearly abl'e to formulate in my own 
words. T^^ danger Is, that mj^ formiilatlaffs might nat be as accurate 

and clear as the program's.. 

* * . * '»* 

I thjnk tKe demonstrative Vessbns would be great for pre-serv- 
ice teachers. Lil^e a\Mdntessar1 method, it gWes them at least one 
way that works - and to start out they jiee4 that! 7- 

\ 

B. PCO0 ^ . ^ , , 

1. Very well organized! * 
^ *2. Not too sure about computer teaching^- too many foul upsu* 
for me. But otherwise good technique for individuaVized-/^ 
\ instruttion. v ^ 

^ ^3. I feel I gained a good understanding of phonics tonsiderini 
<; I ilever had it before. 

^ 4: yWouT^ave done better hadxm)re time been'^Jl-owed. Ona * 
hour long enough at a' time. . , / 

5. Feelithis should be irtad^ into a requiped course, especially 
to prospectilfe^teache^! ! I . v ' . ■ 

V-.. ■ Vv-;- 
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C. PRR 

I have no comment aBout this course, in the fact that it did 

teach phonics and I know the notes that I received from the cour^ 

will help me greatly even if J can't say the^r^^les from riind.^ They 
will be 9 good i^eference for. roe. Thanks, \ f 



D. PCK ; . :^ . 

.. Since this is the. first and vonly teaching phonics coui^se'l' ve 
ha.d,-l guess my evaluation might not ©e'really objecjive. - . . 
^ I thought the courss wa's wort|while\ It priented a practica'l 

approach to dealing wi^ phonict in tie .elemieTi^ary^chi(ij*rT--it seemed 
to .cover alT they areas 'Jthat mosA te^acl^ers woyld be coficernedi about, -r 
i.e.,i^hose areas that would be diff/u^. to" introduce. The lesson was 
■applicable to all jrreaj therefor^/a^y, for teachprs to rememl er. '^ 

rthink^he course wi^^" help- me as a teacher'^and I'lft^glad I 
took it because otherwise I p'roHabl-y would never had had suchlan i»- 
depth instruction- to teaching phonics. And Miked- working with the 
computers.' It was a good experience to experience- the advantages and > 
disadvantages of computerized programming. 




E. ,PDK ■ ; • '■ J- 

( ^ I think the course was well wor^h while^ There was adequate 
repetition wh'ich er^bled many concepts to bfe recClleli, and^',al so\ayt 
my* notes for/future reference. I think it is a very effective' way td\ 
present phonTc;^'.| If I had .to learn the process in class; I probably 
wiuld have been bored to death. By 'using the comput^rAl not^only was 
•introdu^d to computerized instruction, but also was keflt ac^^Ty^-|. 
involved -in the leaj-fiing process. • I'wa^ especially glad to" have ttfken 

J . ■ . J: ' ' : ^ 
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the course^iiitefi-! found that a- girl who was student Reaching where I 
will be next' term gave 50"*fihonics lessons -in the first five wee'ks.. I 
knew nothing, about it before, but now I have a good foundation to build 
on. 



F. _ PCO 
< i 




Very helpful. I knew .l^othing at all before the course. I 
fhink that these 'types pf courses should be available .m other areas, j 
too, * i ^ ' . 

At times I didn.'t know something ^ I wanted to '^ueitiorr some-^^ 

• / ^ ' " - . r 

thing and I was unable. ( For .example,* it was v^ry ^fru-stfating when l 
■ didn't know something and the computer kept saying, "try again, e.^^ " - 
^and then I didn't find out anyway! I enjoyed the* program 'and ben?- 

H. pcv ; ' / . ■ . 

/I ffeel this course was very good because it presehted( material.'' 
1 I really didn't know or understancl as it really "wasn't covered in 
' * . .• • . 

my. elementary years / 1 feel it. will be very beneficial to me when I 

"" ■ • I ' .-^ . ' 

start teaching. ' A 

lil^d It— b^^ I'm not gdirj^ tolhave to s^U through. p^htfVe. -' 

course in-^^t— anrf tnat'k nice. The progUm wouTU have to be ^lof' 

smeathe/ Wiot just the mechanical fa ilurA^-^ there v^r? many pauses .and- 

gaps in transitions ^nd responses to tnput)\to have a fu-ll ' course A 
. • ■ ' . -'^ . • • . ' • 

into trouble ftith the different phonetic .'context used in the vowej 
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secuon but fee.l that this isn't necessarily important for phonics 
instri^ction on the elementary school level. . As. educators though, I 
feel, that teacher^ -of reading should at least have an awareness of - ' 
these phonetic cf fferetJces before' they go into a ^teaching 'Sttuat^or^ 

The»;e-we^e times when the .prog-ram itself frustrated me— not 
accepting ca>trec;f answers, ■ slow responses and. .transitions. ButVj^am 
really 5lad that I have participated in your project--have tearned more 
than phonics onstV-uc'tiotiJ Thank 'you/ \ '\ ^ 

P..S, Your t^nal test is much too lor>g, - ^ » 

, I enjoyed 1t,, great learning 'experience, -Tike on^-to-one 
le^Aiing teaching situation-. Think comptJters ara ^progranined wall. 
Think more courses should be given this^Vay^/ . . , . . 

. . .' . ■ ■• , 

K. PNM ' ^ ' ' ■ 

I felt the course was' structured well- because I feel it dealt 
with a great many aspects of phonics. and phonics instrutcti on.* It * 
really did presept a great deal' of repetitlofi and thlng^ werfe' always 
beinig^reviewed which I feel is gopd. The only thrn^ I^^elt was wrong 
was this posttest. -I feel l^t was really, locr much. 

-.L. PDF , , , • • 

' 4- ■ • 

I he course was good in,that r gajned a lot of knbwiedge a^out 

instructiqn,. Also,- I-. Tike the fact that it .taught. by com- ' 

puter— I f\id the computer to'bfe mucfv more Interesting than many of my 

1 ^ j • ► • , • . .. 

profs. However, I thpughtHhe posttest was much too long.v 
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M.XPPM 

' - ^* » ' ' ' ^ . ^ ^ . 

Responding- to questions .was often frustrating when computer 

wouldn^t accept answer because it wasn 't -exact 'ij^ptds; the frames were 
good -in that we Could, evaluate our 6w answer. ^ 

" • I don't-think it is good to.el iminarte any parts ^of the prog[ram* 
based on ^he pretest - you can answer things on <he pretest icCordjng 
td Acperienc^ with'them. even though you may not compl'etely understand, 
why,/ ? ' \ \ . . ' V * • . " - 

I think, the unit Is a good ohe for those who knewnothiftg of 
phorvics before. There was an awfu1*lot of ma tec'laJ-^ given. I also 
think it was good .to give the sample lesson as V way to,apply-eur 
learhing.' ' . * ' 



■n. .PPY 

^ • I thought the'^\ours9\ WBs good; interesti|jg, to_the polYit^ easy 
't6 understand. 



The ttext required\oo many memor.izatlons of letter combina- 
^i^'I tkpught perhaps, were unnecessary. JJ^ey cQuld be kept it). book 
or notebook. But 1 ca^ji See whyjt was- necessary to ask' them on this ' 
particular test. * • . 



-A 



i 



> 



- 1 • ■ 



0. PMB * . I 

{ The course was motivating for several reasons; it was a* unique 
and interesting process; I could compete w1th.ii\yself and I etfuld go at 
my own pate. . * ( ' • . ' ' ' 

/. Criticisms would ^ the troubles from the machines. 



ERIC 



I; 



283 



P. PMH 

I thought theL course was good but I like to see a teacher 
because then you can see his facial expressions which give clues to 
what he wants you to learQ, I really learned- a lot' even though this 
test may not show it- , But. compared to what I knew when I came in, I 
learned. a lot. I wish themachlne would have gone faster and not so* 
many'illustrative lessons. 

• \ ■ 

Q. PPH - . - 

Refilly feel' [I] learned something from course. 

Object to 'tength of test— much Involves only merftarizatlon of 

* . * ' * ( ' < 

•lists— I don't f^el this 1s necessary as you can always Ibok them up 

useless memorization. \ ^ , , ^ 

One objection tp coiifiejs -constant repetition of verj)^^similar 
*- • . * ' ^. 

lessons over .again. i0ther thdn that the only objection I had'wa's 

•technical— too lonfci to change frames. ENJOYED COURSE • 



R.' PNN 



I found this phonics. program to- be ^extremely, helpful 'and worth- 
while.".! did enjoy working through thfe program arid I do thinK it ' 

• * i - * . 

should somehowvbe worked into the El. Ed. curficulijm because everything 
given in the.course would be of very good use for any El. Ed, ntejor 
since we are the ones whe-wi-ll be introducing phonics to the children. 



r 
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I felt that the course was Inter-esting but that the exam was 
notffair. It. asked for total feecfback of^ niemVi^rzed material and ;iot 
^ knowledge of material leaYned. -I feel more^'emphasis' should have been 
placed .on the latter.** 

y 

Working en the computer was interesting and. the set-up was 
qoo(\/ All" the matenal I hKVe leafned'^will come in handyl ;t^,has ' 
already helped me in readitfg projects with small children. The mat^- 

,ria.ls ioi/ld-be uSed for< Ut^er^reference and that is one reason I don't t 
understand the complex details .used in the exam. Some^f the ques- 

. tion's weren't worded well enough for me to understand what you want; 
it Diay have been my int^pretation "of tl!^ 



question or " inconiplete 



headings m my 'notes. 



T. PBH0 1 



\ ' , The course was somewJjat dull after a wh^ile. -It was. bothersome 
to wait for the delay, that th^ computer was always maljinsf. More ■ 

r \ 

variety in the. miethod tOf presentation of material, would have brought. 

more interest,^ Bu^he coursydfd teach the princ1pl€s\f phonics. I 
|..am afraid. that most learners though woyld soon forget all but the most 
'basic'^rinciples if. there is no rej^lew or Vpllow-jp. ' Possibly the 

cout^^e .could be used in fc^hjijinctlbn with other modes of ^instruction ' 

such as discussions^ work sheets, lectures, practice teaching. etCi 

Jhere^»houl;J.be a way made of making the students study as thev 

go along in th^oyrse.. Possibly testing for evaluation could be. done 

after each major section of the course instead of all at ofice. • ^ 

, ' ' . •A. - ' . 

...» 



. . • . 285 

0. PGH " > ' 

I thought the course Avas* outstanding. I feel that the lessons 
were Well structured, and most Importantly" of* al I, they gave me the 
necessary procA(iure, principle's, aftd content. 

Content : everything was incluited. ^ There, wa^s only one problem. 
In, the pretext ^ I chose what ^ thought to be a ridiculous answer since 
I didri't know. There should be' a choice box saying Tdon't knowT^ 
0^ej«"^tHan that, .comment was excenei^t.-^ , , . ; 

Procedure ; great combination of ,auJlo, CFIT and ima^i^. The 
lessons wfere cjear'and easy to follow, and. the rejyetUion^drined > 
procedure into my head-. / ^ 

Principles : the principles listed w>re good but the .best 
things were -the implied principles. just c'an'-t measure -the amount of 
iijformation* I^gbtvffdm ttiis^. 

V.^ PDD' , * 



/ 



^The course was well structured-; it gave a good step by step 
presentation^ 1 felt one sample lesson would have been sufficient. 
Differences for different concepts could have been mentioned^, but there 
was much repetition which was sort of boring. * ^ . . 

W, PKS . * .- ' * 

/ ' ^ 

' ^ ^ . > 

^ I feel the course was worthwhile. It made learning phonics— 

something that <|oesn't particularly excite manyspeople--a lot more 
interesting. I was also interested 1n\participating ^ecause I've fSeard 
of CAI "and this ts probably the only 6p^ortunity Ir^i]] have in college 
to actually see aadv unders.tand^ how 1t/Works. Mechanical difficulties 
of.ten proved frustrating to tnyself and others, j^wever, ! .realize this. 
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IS Jiot part of the program."" This made it seem' much longer than ft 
•actually was. I feel some of the questions^ on the posttest 'were 
rather*"ambiguous--not clear. « . • ' ' 

I thi^k this was a worthwhile idea.- It was well organized/ftfld 
I liked the ideayof .usj.ng a computer. The course howev a,, i have 
enough examples of tfie areas stressed. ,Lwould feel a lot more com- 
' fortaBle teaching phonics now than 1 would have before. • I also think 
would be worthwhile having this for a ten-week course for prospec- 
tive teachefs^ ^ ' . , , ■ - ^' - 

I enjoyed taking the phonics prpgram, afid I, feel I at least 
learned sofne general information about-what I had never known anyth>n^ 
about befoj^e. This test was' difficult for me because it dealt on 
specifics and details - Had I .knoy/h this I would have been better pre- 
pared, for'it. I feel, though, that this course was effective and I 
hdve some .valuable notes that will aiti me when I do have to introduce 
phonics to my own class. •• ' * 

Z. PBT ( 
^ I thought the course was very.well •organized sequentially and 
the fact that I could work at my own rate is very good. However, there 
were several instances during the -course that a question was a bit » 
ambiguous or just not clear irf my mind." It was unfortunate that I 
could not ask the computier to clarify a s.tatement!or ask the instructor 

-• . ^ . • 

N 



to, 



just what was meant b>"the-.5tatement. Overall, I think it was a qood 
"coU'Tse ancl an e^ccellent one to be usedtt^ft]! the computer. 

AA.. PDC '* ' ' ' . 

The .ou,..e was excellent. I would like to see some sections 
of every . course done on the co'niputer.. The ^novelty is what made 1t 
interesting to learn not so much' the coVitent material, I also liked 
the self-pacing and optional reviews at the end of each .section.' 



/ 
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OPERATIONS ANALYSIS FOR PHONI 

. ^ AUTHOR 



\ Please answer feach question below as thoroughlv as you' can. The com- 
jDents' and recommendations you make will be used to opvimize future 
course operations for the Phoni program. • . ' - 



•1. What, specific operations did you perform in thfe development cind/or 
operation of the Phoni pro^gram? ^ ^ 

a. selected cours) topic ^ 

* » • 

b. wrote scope and sequence of i instruction 

c. duttiored all instructi-onal .materials . ' ^ . 
d/ edl.^ed and checked coUrse materials on-line 

e. tested materials with testing groups 

f. revised ancf retested materials 

g. developed validation plan*/ind ran validation §tudy 

h. -drew and described images on image request forms 

i. arranged for narration and special effects for audio 
recordings 

j. scheduled ahd supervised students 

k. requested and analyzed student/ records 

/. . 

2= Did you experience any complications or undufe difficulties in per- 
forming these operations for- the Phoni program? If so, could" you 
specify the task and the difficulty? 

a. .Jack of programming time and -other teehnical- support 

bepause of lack .of l^nds . ' 

b. ttchmcal difficulties due to systems breakdown 

c. someJHff iculties because of programming "bugs" 

tJ. ^not being fully aware of computer capabilities . . 

< 

3. What recommendations can you mal^e for improving these operations in 
. future course development? What suggestions can you give. so tlv^ 
such complications can be avolcfed in future operations? . - ) 

^ a. author sophistication with computer capabilities 

b. auth or knowledge of programming and especially of proctor 
usages to cope with "buys" as they arise in program 



^ ... 
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knowing exactly what data may be obtained and in what 
form I • ' . . 

d, do\nort fv.^ke arty l^st minute changes that cannot be 
propprly tested - . . " 



do npt undertake any project without complete assurance of 
fund^fig I 

thorough paper organizing and editing before putting 
material on-line , 



g*. ^very ^lose cOmmuntcation^ and p>€mnihg .between ail tech- 
^ nical staff and before beginning any authprirvg 



Do you have arty general recommendations far.the future optimiza- 
tion of this product? \^ 

,a. revise materials &nd update .edit, flinctions as recommended 
in text ' 1 

b b, retest materials und^r conditions sugges'ted 



c. continue to use 'course ^ - / 

Did you note any practices fo-llowed in the operational stages of 
this progiram thafjou believe should be maintained, incorporated 
1h other projects or ;th*at you noted as assets? 

a. experimenting with various strategies 

b. author^ proctoring ^" • - - 



/ 
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. OPERATIONS Analysis for ph6ni 
.7 • ■ 



PROGRAMMER 



Please answer each question below as tho/oughlV as you can. The com- 
^ments and recomnienclati.ons you make will be used to optimize future 
course operations .for the Phoni program: ' 

. . • . - • ^ , ■ ' 

1. What specific operations did you perfprm in the devellppment and/or 
'Operation of the Phoni program? ' ' 

a. developed labeling scheme for coordinating audio, image 
and CRT * ^ 

b. prepared authored^ material for input 

logged -imag^ requests and forwarded to graphic^rtist 
^ debugged initta^l on'-line matef lal ^ 

proofread, edited and annotated audio sheets prW to 
narration ^ ' / 

f. made on-lpne revisions and corrections f^om author 
suggestions y 



gi. listened to ipitial audio recording, adj us tedr message 
lengths, noted whe<;'e rerecording wa£ necessary 
^*"\ ^ - ' * . ^ 

2. Did you experience any implications or undup difficulties In 
performing these operations for the Phoni prdgram? Lf so, could 
you specify^ the task and the difficulty? \ 

. ' a. bugs in' program "resulted from changes in audio script at 
time of recording, with, no notification to pro^ammer 



b.^ last mlnut6 revisions by author before a student run 
c. 

d. • 



what recommendations can you make for improving these operat-ions in 
future course development? What suggestions tan you give so that 
such complications can be avoided in future operatidns?* 

a. all changes in audio, image, or program be noted in ^ 
written commurrlcation (and dated) between author and 
programmer ^ 
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4, Do you hav^ any general recommendations for the future optimiza- 
tion of this product? 

- ' * 1 

Only through use and review based on student performaa(ie 

and, commelfits can optimization be achieved. 

5. Dld'you rtote any assets of this program that >ou believe shoi/ld be 
maintained or t5bat were outstanding features? . ^ * 4 

a. creative use of the media 

b. • individualization of cojrse material determined 'by student 

need and^studenrt preference ♦ 

C.I 



d. 
e. 



/ • 



# 
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CAI GRAPHIC ARTIST 



Please answer ea<;h'* question belowUs thoroughly as you canZ The com- 
ments and'^fecommendaVons you make will be used to optlmize-luture 
course bperatlons for the Phoni program. 



< 



■J 



/ 



K What specific operations did jJwj perform In* the development and/pr 
^ operation qf the ^ofil progra^i? ^ ' ^ 

r * — 

4. pre;)aredrand tested CRT graphics 

b. prepared copies for photography / 

(T. ass'is1:ed with photography qf reel/ /' 

d^ . -s^ . ' 

\ 



r 



e. 
f. 
9- 



2. Did ypu exp^rienc? any complications or undue' difficuUies in per- * 
forming these operations for The* Phoni pfograiti? iVi -sd, could. you 
specify tlje-task ^nd.tfie difficulty? 



a. or>Vy wme constr^JInts * 



9 • 



c. 
. d. 
e. 

f. 



< 



3, Wnat recoiwnendatlbns can you make for imorovlng^these operations in 
future course development? What sugge>Mons can you give so that 
*^such complications can be avoided in future operations? 

^S^^preplanr^fng between- author aiW^artlst 

' ju-^ final check of each image as soon as proof is developed 
(should be dated and filed) 

c. allow more time for jmage and reel production 



d. set ua production schedule and follow as closely as 
• possTtye • • / • : . 



4. . .Da you have any"' general recommendations for- the future opt i mi zaV 

tlort of tt)is product? , ■ v . . 

^-y ^ 

5. Did you note aay practices followed in- the operatigna'l stages of 
this program thalJ-you believe should be maintained, incorporated 
in other, prajectsr or that yfcu noted as assets?' \ 

■ .\ . . •• 

a. y6s; h^^rty approval of tJie attempt-^ gather ^eal informa- 
tion- and appTy ifto^ the course preparation strategy 

. b.. :\ r f -. ' • \. ' 

c. 
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OPERATIONS ANALYSIS FOR PHONI • 



systems;analyst 

. ■ . " c0mputer<operator. 

Please -answer each question below as thoroughly as you can. The com- 
ments and recommendations you make will be used tc q'ptlmlzfe future 
course pperations f&r t+ie Phoni program. 



1. 



What specific operations did you perform in the development and/ir 
operation, of the Prioni program? 

. a. assigned sttident ID'numbers- 
; b/ readied, system. for daily time sliarin^- « 

c. systems mfl^nipulation for cperatlcJnal debugging , 



e 

-f 



d., process student records requests n/^ 

* J 



.2.- Did you experience any complications or undue difficulties In per- 
forming th^e operations for the Phohl program? If so, could you 
specify the task and the difficulty? ' 

a. .No more thin usual; however, the fact that the situation 
cited under' "c" (No. 1). exists. Implies problems.^ 

b. It was difficult to fulfill student reeords requests in 
i the short ^Ime allowed. 

■ « 

c. • - - , 
f. * • 

3.. What recommendations can you make for fmproving tHese operations in 
future course development? What. suggestions can you give so that 
such compTications can be avoided in future operations? 

a. AJlow ample time (to be determined by systems analyst after 
revfew of requests) for requests. 

b. More test runs needed to catch errors. * 
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— ^ . / ■ • . . U 

• ■ ' ' 

c. ilake sure all data requested ar.e needed- 

Do you have any general recommendations for the fu/ture opti'mixa- 
t1on of this product? ^ ^ ^ [ 

The more pressure (compression) at the begtr^Mtrg of a^ 
program, the less pressure In the encMg. ^ ^ *^ ^ 

D.id you note any practlcesUollowed iri the- operational stages of 
this program that you believe should be maintained, incorporated - 
in other project? or t|jat you noted as assets? 



b. 

d. 

9- 



. Good "author-progrdmrner coordination of efforts throughout,'' 
provided for consistency^ In program d€fy,elopment. 



I 
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y • TECHffllCAL SUPPORT MANAGLR 

Please answer each question .below as thorougtpy as you can. The com- 
ments and recommendation/ you make will be. u^dT to**opt1mi2e future 
course operations for the Phorri program. * \ 

1. What specific pfperatidns djd you perform In t+ie development and/or 
operation of the Phoni program? 

^ a. coordinate' production of image reel 

b. coordinate production of oydio charts 

c. cOordina^ system schedule . ^ ( ^ ^ 

d. adn\ini strati ve staff of lab 
e. 

. f. 

1. Did you experience any compl ^cations or undue difficulties in per- 
fonning thes« oper^itions for the fhoni program2 If so, could you 
specify the task and the difficulty? 

X . » , 

'a. had a great deal of difficulty securing the image reel on 
tim^ * # 

b. ^ . • 

c. • ■ ^ 

/ d. , • ' ^ - 

e. - ^ . • " . 
' f. 

3. What recommend^itions can you make for improving tl^ese operations in 
future course development?' What suggestions can ybu ylve'so that 
such complications^ can be avoided in fyfure operations? 

^ a. A very close working relationship is needed with all 
parties concerned. 

b. *At least 6 weeks^notice is needed for image reels * 



2% 



c. ^A>6+6se relationship must be established with ail projects 
. In the Lab, / Carre must be taken not t\ assume that the Lab 
' , exists foV" the. support -of only one project. < • 

-d. AocguatejJebu^ing tfine should be pr'ovided before the \^ 
course is 'made available to. students, 



Do yoa have any genera^ necommendatld^s for iJie future optimiza- 
tion of this product? ^ . / ^ ^ 

Adequate docfumentation must be provided* so that fulHJpe 
.employees cjin csntinue to work on Phoni withogt any contact 
.Vjfith the people who developed the cburse. - The documentation 
^ mast be in order that the cpurse could become op^rarional in 
a matter of 'days after remaining dormant for a number of years. 
The CARE 1 |?l>d Elmath documentation manuaTs would ser&e as 
a good mpdel . ' • • ^ 

' \ • ' , • 

Pid yoti note,srm^ practices followed in the^ operational, stages of 
this" program tlrartf you believe should be maintai-ned, incorporated 
in other projHBcts or that* you noted as a^^sets? 

' ^' *** ^ ' ^ 

'*a. Many of ^he. "nitty gritt/* detaTls jwere adequately 
handled By the Phoni staff. 

■• r ' ' 1 

b'. A great deal of pre-planning appears to have gone into the 
-project feipr to the time the projece became operational. 



r 
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OPERATIONS ^fNALYSIS FOR PHONI- 



AUDIO SPECIALIST 



Pfease answer each question belowij^as thoroughly as you can. The gom- 
ments and recommendations you make boused to opti;n1ze future • ^ 
course operations for the Phopi-prbgramy 



\ 



/ 



/ 



What specif^ic cperatipifs did you perforoi In the development -ancJ/or , 
operation of theCPhoril program? , - ' . / 

He^^d^Hti audio recordings 



a. 
b. 

>4.- 

/ 

f. 
g. 



Assembled iiudio recordings, into' course, 



Dicl you experience any complications or undue difficulties in 
performing these operations for the-PhonI program? If so, could 
you^speclfy the task and the difficulty?/^ 



a. ^.None 

b. 

c. 

d. . 

e. . ' 



>g- 



What recommfervdations can you make*fpr improving these operations in 
future cQurse development? Wh^it suggestions cai^ you give so that % 
su6h compl tcatlons can be avoided in future oberations? \ 



/ 
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4. Do you have any general recommendations ^or the future opiimiza- 
tion of this product? 



5. Did you note any practices followed in the operational stages of 
this program that you believe should be maintained, incorporated 
in other projects or that you noted as assets? 



a. 
b. 
c. 
d. 
e. 
f. 

g. 



